-- Logs begin at Mon 2022-07-18 15:48:09 UTC, end at Mon 2022-07-18 17:15:02 UTC. -- Jul 18 16:41:32.227965 dv-cinder-837542-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 16:41:32.238883 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 16:41:32.241710 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 16:41:32 2022] *** Jul 18 16:41:32.241710 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 16:41:32.241710 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 16:41:32.241710 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: nodename: dv-cinder-837542-6-iscsi Jul 18 16:41:32.241710 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: machine: x86_64 Jul 18 16:41:32.241710 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: clock source: unix Jul 18 16:41:32.241710 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: pcre jit disabled Jul 18 16:41:32.241710 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: detected number of CPU cores: 4 Jul 18 16:41:32.241710 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: current working directory: / Jul 18 16:41:32.241710 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: detected binary path: /usr/bin/uwsgi-core Jul 18 16:41:32.241710 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: your processes number limit is 47680 Jul 18 16:41:32.241710 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: your memory page size is 4096 bytes Jul 18 16:41:32.243035 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: detected max file descriptor number: 2048 Jul 18 16:41:32.243035 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: lock engine: pthread robust mutexes Jul 18 16:41:32.243035 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: thunder lock: enabled Jul 18 16:41:32.243035 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 16:41:32.243035 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 16:41:32.282511 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: Python main interpreter initialized at 0x5564b2e429c0 Jul 18 16:41:32.282511 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: python threads support enabled Jul 18 16:41:32.282511 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: your server socket listen backlog is limited to 100 connections Jul 18 16:41:32.282511 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: your mercy for graceful operations on workers is 90 seconds Jul 18 16:41:32.282881 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 16:41:32.282962 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: *** Operational MODE: preforking *** Jul 18 16:41:32.283182 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: *** uWSGI is running in multiple interpreter mode *** Jul 18 16:41:32.283182 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: spawned uWSGI master process (pid: 110317) Jul 18 16:41:32.283439 dv-cinder-837542-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 16:41:32.284805 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: spawned uWSGI worker 1 (pid: 110318, cores: 1) Jul 18 16:41:32.285687 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: spawned uWSGI worker 2 (pid: 110319, cores: 1) Jul 18 16:41:32.285687 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 16:41:32.960194 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:41:32.969600 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:41:34.079267 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:41:34.079267 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: from cryptography.utils import int_from_bytes Jul 18 16:41:34.079950 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:41:34.079950 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: from cryptography.utils import int_from_bytes Jul 18 16:41:34.080893 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:41:34.080893 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: from cryptography.utils import int_from_bytes Jul 18 16:41:34.081422 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:41:34.081422 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: from cryptography.utils import int_from_bytes Jul 18 16:41:36.782662 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:41:36.783922 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:41:36.784038 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:41:36.784381 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:41:36.784635 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:41:36.785035 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.787252 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.787252 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.787252 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.787252 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.787252 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.787252 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.787252 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.787842 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:41:36.788210 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.788302 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:41:36.788388 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.788388 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.788522 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:41:36.788588 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-6-iscsi {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.788659 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:41:36.788731 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.788804 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:41:36.789047 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.789147 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.789370 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.789466 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.789705 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.789850 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.790035 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.790123 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.790368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.790461 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.790671 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.790820 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.791062 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.791149 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.791388 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.791600 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.791715 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.791912 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.792024 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.792218 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.792333 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.792553 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.792684 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-6-iscsi {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.792865 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.792999 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.793219 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.793369 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.793529 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.793657 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.793834 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.793969 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.794143 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.794283 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.794445 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.794573 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.794761 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.794925 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-6-iscsi {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.795177 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.795452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.795556 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.795775 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.795881 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.796093 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.796248 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.796393 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.796574 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.796734 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.796878 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.797080 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.797226 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.797427 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.797615 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.797731 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.797926 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.798046 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.798247 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.798374 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.798565 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.798751 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.798925 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.799835 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.799940 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-6-iscsi {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.800138 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.800337 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.800432 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.800653 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.800749 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.800972 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.801097 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.801352 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.801446 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.801655 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.801751 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.801934 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.802027 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.802241 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.802327 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.802561 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.802656 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.802881 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.802981 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.803204 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.803297 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.803474 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.803575 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.803743 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.803870 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.804080 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.804193 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.804418 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.804530 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.804729 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.804902 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.805347 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.805538 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.805708 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.805852 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.806125 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.806314 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.806472 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.806613 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.806760 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.806942 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.807083 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.807220 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.807412 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.807567 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.807716 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.807873 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.808013 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.808159 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.808308 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.808460 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.808631 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.808777 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.808918 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.809094 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.809094 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.809385 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.809534 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.809684 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.809825 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.809970 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.810117 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.810257 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.810396 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.810559 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.810699 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.810855 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.811035 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.811182 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.811322 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.811470 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.811616 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.811755 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.811901 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.812047 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.812193 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.812334 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.812480 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.812633 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.812776 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.812917 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.813071 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.813226 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.813226 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.816116 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.816259 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.816353 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.816434 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.816513 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.816591 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.816683 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.816763 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.816841 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.816926 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.817004 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.817116 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.817116 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.817290 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.817370 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.817450 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.817450 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.817605 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.817694 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.817773 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.817857 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.817935 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.818011 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.818102 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.818182 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.818268 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.818268 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.818426 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.818504 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.818593 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.818680 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.818756 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.818833 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.818905 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.818981 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.819067 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.819146 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.819222 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.819305 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.819385 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.819451 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.819537 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.819731 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.819830 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.820047 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.820136 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.820350 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.820447 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.820676 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.820770 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.820994 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.821161 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.821320 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.821421 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.821629 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.821715 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.821935 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.822024 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.822244 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.822331 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.822551 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.822636 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.822884 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.822987 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.823183 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.823278 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.823507 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.823593 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.823823 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.823909 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.824129 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.824215 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.824448 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.824545 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.824771 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.824863 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.825101 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.825205 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.825413 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.825507 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.825720 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.825804 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.826025 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.826113 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.826329 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.826415 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.826628 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.826714 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.826940 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.827038 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.827250 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.827335 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.827553 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.827714 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.827857 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.827943 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.828160 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.828246 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.828476 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.828570 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.828782 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.828905 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.829113 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.829236 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.829422 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.829620 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.829746 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.829955 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.830046 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.830396 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.830500 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.830742 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.831001 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.831085 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.831186 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.831345 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.831444 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.831667 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.831753 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.831992 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.832078 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.832306 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.832401 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.832616 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.832703 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.832925 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.833078 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.833311 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:41:36.833412 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.833628 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.833713 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.833956 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.834042 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.834273 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.834368 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.834588 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.834675 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.834925 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.835017 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.835260 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.835351 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.835614 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.835707 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.835989 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.836097 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.836309 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.836407 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.836621 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.836707 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.836941 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.837111 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.837285 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.837374 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.837611 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.837705 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.837932 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.838016 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.838254 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.838340 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.838566 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.838651 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.838946 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.839100 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.839195 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.839275 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.839506 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.839601 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.839819 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.839902 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.840135 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.840234 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.840448 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.840535 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.840757 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.840893 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.841089 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.841180 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.841423 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.841511 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.841834 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.842015 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.842098 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.842176 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.842401 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.842496 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.842738 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.842866 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.843085 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.843172 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.843401 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.843488 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.843722 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.843832 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.844045 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.844140 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.844354 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.844439 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.844662 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.844750 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.844986 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.845097 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.845325 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.845410 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.845642 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.845731 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.846480 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.846710 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.846798 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.846874 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.847176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.847425 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.847533 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.847685 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.847832 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.848009 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.848184 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.848333 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.848510 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.848651 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.848837 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.848976 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.849186 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.850368 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.850463 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.850546 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.850616 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.850692 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.850773 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.850988 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.851061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.851136 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.851213 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.851294 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.851363 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.851464 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.851539 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.851613 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.851681 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.851828 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.851932 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.852236 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.852385 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.852522 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.852704 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.852844 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.852982 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.853124 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.853208 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.853399 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.853496 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.853715 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.853802 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.854036 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.854138 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.854341 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.854438 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.854658 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.854752 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.854965 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.855052 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.855273 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.855367 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.855672 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.855773 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.855900 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.855986 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.856210 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.856304 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.856530 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.856621 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.856836 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.856922 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.857172 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.857274 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.857490 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.857589 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.857802 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.857888 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.858105 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.858244 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.858406 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.858494 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.858752 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.858869 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.859074 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.859176 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.859376 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.859496 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.859676 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.859791 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.859975 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.860063 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.860355 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.860526 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.860617 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.860706 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.860881 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.860969 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.861189 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.861318 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.861621 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.861819 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.861917 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.862133 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.862251 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.862448 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.862557 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.862759 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.862895 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.863069 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.863225 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.863377 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.863540 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.863689 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.863930 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.864030 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.864189 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.864277 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.864528 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.864623 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.864926 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.865031 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.865290 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.865375 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.865598 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.865686 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.865906 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.866258 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.866482 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.866575 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.866793 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.866880 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.867095 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.867254 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.867403 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.867489 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.867784 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.867872 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.868093 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.868180 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.868411 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.868505 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.868715 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.868801 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.869045 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.869135 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.869394 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.869520 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.869719 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.869817 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.870051 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.870137 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.870367 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.870467 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.870676 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.870761 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.870988 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.871086 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.871302 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.871410 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.871625 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.871763 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.871915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.872003 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.872222 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.872318 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.872534 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.872622 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.872840 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.872927 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.873184 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.873273 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.873495 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.873583 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.873811 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.873903 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.874116 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.874203 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.874430 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.874515 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.874730 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.874816 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.875056 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.875150 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.875380 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.875473 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.875697 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.875783 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.876023 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.876196 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.876333 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.876429 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.876650 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.876744 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.876955 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.877735 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.877888 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.878040 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.878155 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.878258 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.878453 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.878549 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.878758 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.878851 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.879082 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.879183 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.879400 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.879502 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.879713 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.879811 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.880014 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.880109 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.880315 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.880450 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.880629 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.880716 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.880936 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.881053 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.881289 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.881515 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.881619 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.881701 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.881951 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.882041 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.882267 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.882353 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.882581 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.882678 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.882891 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.882986 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.883201 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.883295 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.883510 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.883606 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.883821 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.883907 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.884139 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.884227 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.884453 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.884549 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.884765 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.884852 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.885107 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.885209 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.885411 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.885505 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.885725 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.885820 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.886035 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.886122 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.886341 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.886436 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.886654 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.886740 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.886974 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.887067 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.887281 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.887379 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.887594 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.887687 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.887903 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.887991 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.888209 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.888296 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.888515 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.888612 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.888842 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.888928 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.889177 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.889266 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.889487 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.889574 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.889800 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.889912 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.890108 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.890204 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.890448 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.890533 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.890759 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.890844 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.891068 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.891156 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.891417 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.891544 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.891723 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.891819 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.892025 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.892117 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.892331 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.892417 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.892673 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.892801 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.893148 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.896112 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.896253 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.896339 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.896426 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.896514 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.896602 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.896689 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.896769 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.896848 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.896926 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.897031 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.897114 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.897193 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.897271 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.897271 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.897436 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.897516 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.897602 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.897690 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.897787 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.897868 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.897946 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898023 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898109 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898189 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898274 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898355 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898433 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898433 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898573 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898652 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898718 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898791 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898791 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898917 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.898997 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.899075 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.899261 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.899350 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.899563 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.899663 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.899873 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.899988 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.900184 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.900306 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.900485 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.900647 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.900815 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.900958 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.901165 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.901295 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.901499 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.901605 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.901809 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.901897 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.902112 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.902199 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.902436 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.902536 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.902758 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.902846 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.903090 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.903174 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.903402 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.903497 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.903708 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.903796 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.904014 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.904134 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.904320 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.904475 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.904628 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.904781 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.904947 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.905097 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.905281 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.905419 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.905598 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.905721 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.905908 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.906022 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.906236 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.906325 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.906581 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.906677 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.906856 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.906950 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.907162 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.907250 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.907475 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.907561 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.907800 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.907913 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.908110 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.908790 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.909036 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.909361 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.909589 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.909744 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.910038 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.910137 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.910438 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.910654 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.911000 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.911165 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.911262 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.911549 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.912704 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.912808 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.912880 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.912880 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.912880 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.913138 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.914325 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.914983 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.915093 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.915181 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.915271 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.915352 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.915432 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.915510 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.915591 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.915591 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.915722 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.915788 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.915861 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.915928 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.915928 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.916105 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.916231 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.916553 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.918014 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.918116 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.918214 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.918298 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.918377 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.918464 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.918545 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.918629 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.918716 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.918837 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.918975 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.919060 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.919138 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.919224 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.919314 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.919395 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.919652 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.919738 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.919817 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.919906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.919994 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.920098 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.920180 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.920345 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.920510 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.920655 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.920954 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.921121 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.921296 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.921609 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.921744 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.921945 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.922162 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.922253 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.922520 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.922609 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.922859 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.922966 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.923174 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.923262 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.923484 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.923571 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.923795 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.923919 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.924679 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.924910 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.924991 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.925090 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.925318 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.925396 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.925635 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.925717 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.925949 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.926035 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.926258 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.926344 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.926593 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.926692 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.926869 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.926961 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.927178 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.927273 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.927487 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.927573 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.927793 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.927894 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.928124 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.928225 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.928411 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.928499 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.928727 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.928828 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.929074 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.929166 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.929390 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.929476 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.929701 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.929801 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.930002 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.930096 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.930305 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.930406 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.930616 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.930721 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.930991 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.931090 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.931324 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.931424 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.931534 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.931622 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.931858 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.931957 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.932166 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.932312 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.932476 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.932565 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.932819 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.932905 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.933161 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.933263 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.933473 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.933561 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.933794 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.933891 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.934083 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.934171 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.934399 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.934526 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.934778 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.935025 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.935025 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.935183 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.935305 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.935401 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.935612 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.935699 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.935928 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.936034 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.936235 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.936322 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.936556 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.936768 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.936885 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.936982 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.937220 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.937309 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.937528 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.937614 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.937840 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.937934 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.938142 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.938231 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.938451 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.938535 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.938766 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.938937 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.939075 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.939162 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.939386 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.939473 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.939748 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.939877 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.940067 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.940228 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.940382 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.940576 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.940687 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.940995 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.941165 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.941326 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.941414 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.941639 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.941744 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.941969 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.942056 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.942286 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.942373 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.942595 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.942691 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.942910 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.943004 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.943219 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.943306 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.943525 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.943620 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.943832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.943942 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.944253 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.944339 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.944562 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.944650 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.945093 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.945197 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.945277 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.945355 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.945490 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.945675 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.945797 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.946036 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.946330 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.946480 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.946633 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.946757 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.946944 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.947073 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.947366 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.947467 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.947682 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.947769 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.947984 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.948070 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.948300 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.948395 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.948617 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.948717 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.948927 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.949034 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.949266 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.949368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.949596 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.949752 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.949907 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.950067 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.950216 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.950399 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.950524 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.950721 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.950851 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.951049 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.951156 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.951370 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.951461 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.951677 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.951873 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.951990 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.952192 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.952301 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.952500 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.952624 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.952923 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.953051 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.953265 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.953380 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.953583 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.953672 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.953912 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.953998 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.954239 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.954326 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.954563 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.954650 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.954873 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.955772 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.955919 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.956065 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.956226 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.956377 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.956503 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.956575 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.956641 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.956849 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.956942 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.957202 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.957292 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.957530 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.957619 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.957835 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.957923 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.958140 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.958226 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.958451 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.958537 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.958757 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.958844 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.959084 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.959229 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.959427 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.959560 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.959750 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.959878 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.960079 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.960205 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.960414 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.960581 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.960724 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.960933 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.961137 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.961275 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.961468 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.961583 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.961815 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.961955 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.962130 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.962348 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.962436 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.962687 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.962784 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.963037 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.963129 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.963360 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.963447 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.963660 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.963754 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.963978 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.964066 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.964287 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.964383 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.964589 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.964683 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.964893 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.964981 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.965222 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.965320 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.965563 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.965652 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.965868 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.966019 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.966187 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.966422 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.966510 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.966758 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.966846 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.967115 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.967201 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.967476 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.967565 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.967795 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.967882 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.968111 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.968206 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.968430 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.968517 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.968753 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.968855 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.969121 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.969228 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.969437 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.969552 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.969766 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.969877 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.970104 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.970199 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.970442 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.970530 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.970796 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.971551 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.971683 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.971980 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.972071 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.972344 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.972445 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.972600 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.972747 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.972906 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.973176 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.973281 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.973364 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.973548 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.973648 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.973868 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.973956 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.974174 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.974262 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.974475 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.974570 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.974780 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.974871 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.975082 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.975180 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.975386 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.975473 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.975695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.975782 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.976002 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.976096 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.976331 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.976420 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.976641 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.976735 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.976967 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.977074 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.977301 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.977399 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.977610 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.977696 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.977919 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.978007 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.978227 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.978315 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.978539 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.978625 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.978873 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.978967 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.979188 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.979284 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.979501 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.979588 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.979820 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.979932 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.980125 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.980224 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.980447 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.980544 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.980774 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.980953 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.981112 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.981207 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.981428 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.981690 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.981792 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.982019 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.982197 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.982330 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.982470 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.982631 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.982778 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.982949 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.983082 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.983263 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.983395 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.983567 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.983702 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.983888 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.984013 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.984210 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.984335 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.984553 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.984775 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.984900 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.985137 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.985263 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.985463 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.985589 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.985785 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.985910 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.986106 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.986230 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.986467 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.987081 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.987275 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.987411 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.987535 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.987671 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.987794 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.987938 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.988060 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.988196 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.988322 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.988447 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.988582 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.988703 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.988827 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.988959 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.989121 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.989243 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.989383 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.989504 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.989628 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.989762 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.989948 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.990071 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.990260 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.990383 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.990574 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.990701 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.990890 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.991292 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.991465 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.991600 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.991840 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.991977 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.992113 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.992249 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.992382 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.992505 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.992713 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.992863 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.993148 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.993282 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.993460 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.993581 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.993711 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.993851 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.993995 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.994130 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.994257 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.994482 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.994617 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.994796 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.994935 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.995128 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.995251 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.995451 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.995575 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.995773 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.995918 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.996089 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.996224 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.996408 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.996532 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.996724 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.996850 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.997046 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.997173 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.997354 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.997586 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.997727 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.997905 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.998042 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.998247 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.998382 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.998574 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.998710 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.998904 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.999030 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.999223 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.999356 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.999543 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.999677 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.999849 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:36.999971 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.000174 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.000377 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.000515 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.000756 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.000880 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.001110 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.001235 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.001427 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.001631 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.001762 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.001954 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.002188 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.002889 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.003013 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.003207 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.003346 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.003482 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.003671 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.003796 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.003926 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.004066 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.004190 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.004190 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.004431 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.004564 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.004703 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.004829 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.004967 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.005151 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.005271 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.005394 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.005529 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.005668 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.005789 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.005923 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.006045 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.006168 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.006304 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.006435 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.006557 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.006681 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.006805 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.006940 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.007061 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.007193 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.007318 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.007441 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.007564 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.007701 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.007824 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.007996 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.008120 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.008302 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.008435 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.008604 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.008735 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.008931 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.009081 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.009268 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.009408 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.016249 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.016526 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.016660 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.016792 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.016916 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.017079 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.017295 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.017418 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.017560 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.018211 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.018349 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.019071 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.019214 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.019343 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.019481 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.019606 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.019735 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.019889 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.020012 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.020141 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.020269 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.020397 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.020532 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.020680 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.020803 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.020930 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.021083 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.021226 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.021226 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.021472 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.021472 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.021778 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.021778 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.022034 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.022170 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.022321 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.022458 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.022458 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.022713 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.022839 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.022976 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.023098 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.023233 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.023353 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.023489 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.023611 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.023745 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.023745 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.023982 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.024120 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.024246 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.024376 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.024376 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.024634 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.024771 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.024892 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.025187 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.025187 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.025451 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.025580 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.025714 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.025853 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.025978 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.026118 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.026242 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.026369 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.026495 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.026622 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.026760 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.026896 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.027019 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.027159 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.027290 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.027417 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.027557 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.027695 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.027817 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.027946 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.028073 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.028202 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.028342 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.028466 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.028603 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.028728 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.028856 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.029000 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.029170 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.029311 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.029434 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.029559 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.029685 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.029828 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.029961 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.030083 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.030211 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.030335 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.030462 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.030599 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.030725 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.030852 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.030976 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.031102 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.031227 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.031369 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.031502 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.031624 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.031759 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.031883 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.032021 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.032143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.032274 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.032398 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.032582 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.032771 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.032932 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.033080 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.033208 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.033208 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.036695 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.036772 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.036772 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.037000 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.037126 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.037205 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.037282 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.037282 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.037452 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.037532 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.037532 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.037675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.037799 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.037895 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.037983 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.038062 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.038062 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.038192 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.038269 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.038269 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.038420 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.038498 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.038498 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.038638 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.038723 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.038803 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.038803 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.038955 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.039035 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.039113 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.039197 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.039277 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.039354 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.039439 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.039439 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.039580 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.039665 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.039752 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.039831 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.039831 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.039970 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.040048 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.040133 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.040232 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.040310 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.040310 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.040458 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.040548 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.040548 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.040691 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.040768 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.040768 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.040909 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.040998 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.041152 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.041235 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.041235 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.041377 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.041454 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.041454 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.041623 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.041750 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.041874 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.042015 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.042111 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.042329 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.042586 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.042710 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.042965 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.043168 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.043337 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.043609 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.043743 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.043934 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.044271 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.044364 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.044595 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.044832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.044920 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.045245 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.045346 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.045569 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.045664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.045890 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.048486 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.048486 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.048639 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.048718 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.048807 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.048807 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.049091 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.049219 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.049433 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.049922 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.050016 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.050097 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.050175 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.050253 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.050346 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.050435 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.050523 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.050603 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.050603 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.050751 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.050831 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.050906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.050980 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.051047 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.051111 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.051111 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.051265 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.051345 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.051345 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.051485 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.051561 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.051816 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.051917 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.052148 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.052237 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.052484 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.052576 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.052796 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.052891 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.053129 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.053221 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.053445 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.053544 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.053780 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.053879 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.054092 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.054186 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.054409 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.054507 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.054721 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.054850 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.055046 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.055131 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.055369 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.055455 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.055676 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.055763 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.055994 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.056079 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.056314 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.056399 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.056634 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.056721 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.056951 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.057062 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.057295 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.057392 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.057616 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.057703 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.057930 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.058016 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.058241 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.058336 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.058556 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.058641 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.058798 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:41:37.058884 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.059179 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.059502 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.059834 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.060165 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.060482 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.060814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.061173 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.061531 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.061853 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.062206 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.062543 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.062864 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.063182 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.063492 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:41:37.063741 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:41:37.121980 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO dbcounter [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] Registered counter for database nova_api Jul 18 16:41:37.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO dbcounter [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Registered counter for database nova_api Jul 18 16:41:37.237253 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG oslo_db.sqlalchemy.engines [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:41:37.240407 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_db.sqlalchemy.engines [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:41:37.244182 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG dbcounter [-] [110319] Writer thread running {{(pid=110319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:41:37.247264 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writer thread running {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:41:37.304382 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.context [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c0091633-bf58-44a7-8bf2-495d496559e2(cell1) {{(pid=110319) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:41:37.304617 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.context [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c0091633-bf58-44a7-8bf2-495d496559e2(cell1) {{(pid=110318) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:41:37.308436 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:37.308551 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG oslo_concurrency.lockutils [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:37.310045 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:37.310166 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG oslo_concurrency.lockutils [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:37.310858 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:37.310953 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG oslo_concurrency.lockutils [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:37.312991 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:37.313164 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG oslo_concurrency.lockutils [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:37.315090 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO dbcounter [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Registered counter for database nova_cell0 Jul 18 16:41:37.315226 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO dbcounter [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] Registered counter for database nova_cell0 Jul 18 16:41:37.319099 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO dbcounter [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Registered counter for database nova_cell1 Jul 18 16:41:37.319240 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO dbcounter [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] Registered counter for database nova_cell1 Jul 18 16:41:37.326209 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG oslo_db.sqlalchemy.engines [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:41:37.330066 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_db.sqlalchemy.engines [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:41:37.331851 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_db.sqlalchemy.engines [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:41:37.332113 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG oslo_db.sqlalchemy.engines [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:41:37.334002 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG dbcounter [-] [110319] Writer thread running {{(pid=110319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:41:37.338103 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writer thread running {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:41:37.339379 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writer thread running {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:41:37.479352 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG dbcounter [-] [110319] Writer thread running {{(pid=110319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:41:37.488204 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO dbcounter [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Registered counter for database nova_cell0 Jul 18 16:41:37.488876 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO dbcounter [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] Registered counter for database nova_cell0 Jul 18 16:41:37.495394 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_db.sqlalchemy.engines [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:41:37.498911 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG oslo_db.sqlalchemy.engines [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:41:37.499988 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writer thread running {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:41:37.503627 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG dbcounter [-] [110319] Writer thread running {{(pid=110319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:41:37.949386 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: WARNING keystonemiddleware.auth_token [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:41:37.956963 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: WARNING keystonemiddleware.auth_token [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:41:37.965054 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: WARNING keystonemiddleware.auth_token [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:41:37.972621 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: WARNING keystonemiddleware.auth_token [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:41:38.303523 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: WARNING keystonemiddleware.auth_token [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:41:38.309557 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: WARNING keystonemiddleware.auth_token [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:41:38.314864 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5564b2e429c0 pid: 110318 (default app) Jul 18 16:41:38.316513 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: WARNING keystonemiddleware.auth_token [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:41:38.317121 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:38.318322 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] 10.222.0.76 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001857 Jul 18 16:41:38.318727 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 788 bytes} [Mon Jul 18 16:41:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:41:38.322633 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: WARNING keystonemiddleware.auth_token [None req-9f33fa39-f043-4fd4-9f00-957f6bca5188 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:41:38.327963 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5564b2e429c0 pid: 110319 (default app) Jul 18 16:43:00.646205 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:00.647824 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Jul 18 16:43:00.653345 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 2/2] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:43:00 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:00.661939 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG dbcounter [-] [110319] Writing DB stats nova_api:SELECT=3 {{(pid=110319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:00.662877 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG dbcounter [-] [110319] Writing DB stats nova_cell1:SELECT=3 {{(pid=110319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:00.663624 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG dbcounter [-] [110319] Writing DB stats nova_cell0:SELECT=3 {{(pid=110319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:00.664346 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG dbcounter [-] [110319] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:01.583559 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-1a766b70-6e6a-4bd4-b4fa-53fe6617cc18 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:01.617087 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-1a766b70-6e6a-4bd4-b4fa-53fe6617cc18 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.960610 Jul 18 16:43:01.625100 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 1/3] 10.222.0.76 () {60 vars in 1291 bytes} [Mon Jul 18 16:43:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:03.934395 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:03.935389 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-f4929adf-e7e5-4f78-b640-8e4b7864b4d6 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 Jul 18 16:43:03.935792 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 3/4] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:43:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:04.392205 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-1a330cac-59c2-4e60-9079-1f41a7078812 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:04.410542 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:43:04.410542 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: warnings.warn(msg) Jul 18 16:43:04.491331 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-1a330cac-59c2-4e60-9079-1f41a7078812 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.549160 Jul 18 16:43:04.491900 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 2/5] 10.222.0.76 () {64 vars in 1282 bytes} [Mon Jul 18 16:43:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:43:04.722150 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-d607514f-dd21-4c64-b453-9bb9657a7675 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:04.724580 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:43:04.724580 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: warnings.warn(msg) Jul 18 16:43:04.740710 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_api:SELECT=3 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:04.741217 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_cell1:SELECT=3 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:04.742014 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_cell0:SELECT=3 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:04.742659 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:04.853714 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-d607514f-dd21-4c64-b453-9bb9657a7675 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.352252 Jul 18 16:43:04.854588 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 4/6] 10.222.0.76 () {64 vars in 1335 bytes} [Mon Jul 18 16:43:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:07.282492 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-1a330cac-59c2-4e60-9079-1f41a7078812 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:07.284300 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-1a330cac-59c2-4e60-9079-1f41a7078812 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002290 Jul 18 16:43:07.284953 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 3/7] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:43:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:43:07.989583 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-774832d2-c4d4-4da3-9267-b777e1ac541c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:08.010566 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:43:08.010566 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: warnings.warn(msg) Jul 18 16:43:08.181511 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-774832d2-c4d4-4da3-9267-b777e1ac541c admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.888492 Jul 18 16:43:08.182169 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 5/8] 10.222.0.76 () {64 vars in 1282 bytes} [Mon Jul 18 16:43:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:43:08.195320 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-bb0a53a4-7516-45d0-bcab-2049f3e79855 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:08.196814 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:43:08.196814 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: warnings.warn(msg) Jul 18 16:43:08.320344 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-bb0a53a4-7516-45d0-bcab-2049f3e79855 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128920 Jul 18 16:43:08.329303 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 4/9] 10.222.0.76 () {64 vars in 1335 bytes} [Mon Jul 18 16:43:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:10.616302 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-774832d2-c4d4-4da3-9267-b777e1ac541c admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:10.617461 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-774832d2-c4d4-4da3-9267-b777e1ac541c admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Jul 18 16:43:10.617864 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 6/10] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:43:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:11.038833 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-ec62806d-76b5-486f-ab6b-967264be1a4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:11.132459 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-ec62806d-76b5-486f-ab6b-967264be1a4d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.507977 Jul 18 16:43:11.133080 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 5/11] 10.222.0.76 () {64 vars in 1282 bytes} [Mon Jul 18 16:43:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:43:11.145716 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-55909685-7e37-42b7-933e-b591e3459ef5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:11.228005 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-55909685-7e37-42b7-933e-b591e3459ef5 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085898 Jul 18 16:43:11.228583 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 7/12] 10.222.0.76 () {64 vars in 1335 bytes} [Mon Jul 18 16:43:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:13.461705 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-ec62806d-76b5-486f-ab6b-967264be1a4d admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:13.462725 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-ec62806d-76b5-486f-ab6b-967264be1a4d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 18 16:43:13.463126 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 6/13] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:43:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:13.950864 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-99153d1b-223b-4c09-a9a3-7a3d96ac4fef admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "disk": 10, "vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:14.031385 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-99153d1b-223b-4c09-a9a3-7a3d96ac4fef admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.562320 Jul 18 16:43:14.032114 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 8/14] 10.222.0.76 () {64 vars in 1282 bytes} [Mon Jul 18 16:43:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:43:14.044704 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-d4e678a0-9a12-48da-aea1-7d2a4ea588b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:14.137608 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-d4e678a0-9a12-48da-aea1-7d2a4ea588b0 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096792 Jul 18 16:43:14.138205 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 7/15] 10.222.0.76 () {64 vars in 1335 bytes} [Mon Jul 18 16:43:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:16.397480 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-99153d1b-223b-4c09-a9a3-7a3d96ac4fef admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:16.399014 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-99153d1b-223b-4c09-a9a3-7a3d96ac4fef admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Jul 18 16:43:16.399409 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 9/16] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:43:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:16.854658 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-d07eb319-f3c2-40ca-99a3-22316c72a088 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:16.942521 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-d07eb319-f3c2-40ca-99a3-22316c72a088 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.534622 Jul 18 16:43:16.943202 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 8/17] 10.222.0.76 () {64 vars in 1282 bytes} [Mon Jul 18 16:43:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:43:16.956282 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-739aeb30-9875-4f7f-9542-c754400f5169 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:17.033908 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-739aeb30-9875-4f7f-9542-c754400f5169 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081537 Jul 18 16:43:17.034488 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 10/18] 10.222.0.76 () {64 vars in 1335 bytes} [Mon Jul 18 16:43:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:19.607900 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-d07eb319-f3c2-40ca-99a3-22316c72a088 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:19.608917 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-d07eb319-f3c2-40ca-99a3-22316c72a088 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 18 16:43:19.609371 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 9/19] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:43:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:20.059376 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-7af7826d-e623-4d59-8c58-a4df721eb4b1 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:20.083269 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-7af7826d-e623-4d59-8c58-a4df721eb4b1 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.467290 Jul 18 16:43:20.083776 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 11/20] 10.222.0.76 () {60 vars in 1291 bytes} [Mon Jul 18 16:43:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:22.428726 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-d07eb319-f3c2-40ca-99a3-22316c72a088 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:22.429823 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-d07eb319-f3c2-40ca-99a3-22316c72a088 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jul 18 16:43:22.430249 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 10/21] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:43:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:22.871429 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-5682fe5c-a55a-4489-a5a1-91460869afe1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "vcpus": 1, "name": "m1.tiny", "ram": 512, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:22.978939 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-5682fe5c-a55a-4489-a5a1-91460869afe1 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.541679 Jul 18 16:43:22.980103 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 12/22] 10.222.0.76 () {64 vars in 1282 bytes} [Mon Jul 18 16:43:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:43:22.993102 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-e6bac9e6-309d-47c5-9aa9-970b2c84f5d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:23.129871 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-e6bac9e6-309d-47c5-9aa9-970b2c84f5d6 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140610 Jul 18 16:43:23.130407 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 11/23] 10.222.0.76 () {64 vars in 1332 bytes} [Mon Jul 18 16:43:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:25.512591 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-5682fe5c-a55a-4489-a5a1-91460869afe1 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:25.513735 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-5682fe5c-a55a-4489-a5a1-91460869afe1 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jul 18 16:43:25.514142 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 13/24] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:43:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:25.917089 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-6dcbfb97-b2de-4aa3-bbc1-ab2eada786ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "disk": 20, "vcpus": 1}} {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:26.107479 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-6dcbfb97-b2de-4aa3-bbc1-ab2eada786ab admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.587281 Jul 18 16:43:26.108072 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 12/25] 10.222.0.76 () {64 vars in 1282 bytes} [Mon Jul 18 16:43:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:43:26.120503 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-5fd1388c-6213-4996-8aa3-ab354aae0312 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:26.261179 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-5fd1388c-6213-4996-8aa3-ab354aae0312 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.144078 Jul 18 16:43:26.261772 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 14/26] 10.222.0.76 () {64 vars in 1332 bytes} [Mon Jul 18 16:43:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:28.502820 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-6dcbfb97-b2de-4aa3-bbc1-ab2eada786ab admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:28.503953 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-6dcbfb97-b2de-4aa3-bbc1-ab2eada786ab admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 18 16:43:28.504358 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 13/27] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:43:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:28.865394 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-ea4402b3-e5c6-4c0f-be0f-5c1781dfea3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium", "vcpus": 2, "id": "3"}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:29.074320 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-ea4402b3-e5c6-4c0f-be0f-5c1781dfea3b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.564074 Jul 18 16:43:29.074912 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 15/28] 10.222.0.76 () {64 vars in 1282 bytes} [Mon Jul 18 16:43:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:43:29.086845 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-66ae3f07-11d6-4cbf-ad6b-3ba2c6a5f3dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:29.243907 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-66ae3f07-11d6-4cbf-ad6b-3ba2c6a5f3dc admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160690 Jul 18 16:43:29.244485 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 14/29] 10.222.0.76 () {64 vars in 1332 bytes} [Mon Jul 18 16:43:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:31.528949 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-ea4402b3-e5c6-4c0f-be0f-5c1781dfea3b admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:31.530473 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-ea4402b3-e5c6-4c0f-be0f-5c1781dfea3b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001837 Jul 18 16:43:31.533386 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 16/30] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:43:31 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:32.015726 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-af60d479-286b-4d79-9eb8-40137b52f500 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "id": "4", "swap": 0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:32.031011 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG dbcounter [-] [110319] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:32.832804 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-af60d479-286b-4d79-9eb8-40137b52f500 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.295316 Jul 18 16:43:32.833938 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 15/31] 10.222.0.76 () {64 vars in 1282 bytes} [Mon Jul 18 16:43:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:43:32.846634 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-0ff257ed-4990-4467-9edd-c4d8a6e90407 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:32.948233 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-0ff257ed-4990-4467-9edd-c4d8a6e90407 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104613 Jul 18 16:43:32.949265 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 17/32] 10.222.0.76 () {64 vars in 1332 bytes} [Mon Jul 18 16:43:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:35.217160 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-af60d479-286b-4d79-9eb8-40137b52f500 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:35.218878 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-af60d479-286b-4d79-9eb8-40137b52f500 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002227 Jul 18 16:43:35.219339 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 16/33] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:43:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:35.675359 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-e1a580a0-d4b3-4da3-9718-ea15327ad049 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:35.752433 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-e1a580a0-d4b3-4da3-9718-ea15327ad049 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.527034 Jul 18 16:43:35.753166 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 18/34] 10.222.0.76 () {64 vars in 1282 bytes} [Mon Jul 18 16:43:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:43:35.768822 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-dc780923-59de-4d7e-91bb-512cd5aee4a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:35.917538 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-dc780923-59de-4d7e-91bb-512cd5aee4a6 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.152474 Jul 18 16:43:35.918794 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 17/35] 10.222.0.76 () {64 vars in 1332 bytes} [Mon Jul 18 16:43:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:56.302215 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-e1a580a0-d4b3-4da3-9718-ea15327ad049 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:56.303289 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-e1a580a0-d4b3-4da3-9718-ea15327ad049 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 18 16:43:56.303699 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 19/36] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:43:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:56.724151 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-e002cb69-fd51-4751-b828-1a6bf409bdae admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:56.741473 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-e002cb69-fd51-4751-b828-1a6bf409bdae admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.431285 Jul 18 16:43:56.741951 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 18/37] 10.222.0.76 () {60 vars in 1291 bytes} [Mon Jul 18 16:43:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:57.820476 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-e1a580a0-d4b3-4da3-9718-ea15327ad049 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:57.822430 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-e1a580a0-d4b3-4da3-9718-ea15327ad049 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002204 Jul 18 16:43:57.822650 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 20/38] 10.222.0.76 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:58.358926 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-f695b426-8b8a-478e-aa87-3c2655dc2cef admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:58.364854 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.wsgi [None req-f695b426-8b8a-478e-aa87-3c2655dc2cef admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-f695b426-8b8a-478e-aa87-3c2655dc2cef admin admin] Request method failure captured: Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Accept: application/json Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Accept-Encoding: gzip, deflate Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Connection: keep-alive Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Content-Length: 0 Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Host: 10.222.0.76 Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Openstack-Api-Version: compute 2.90 Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Openstack-System-Scope: None Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: User-Agent: python-novaclient Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Auth-Token: gAAAAABi1Y3NoT0V7GSbGbT2mDpvdAs1uh-yGqw9bcX745yFrvjbm9jRT7vSPTNYtgoANM4y28nPP2gv9XatR2wLmQov4jzIpJ8RwbUk083hooFIZNblf-r9MnE5nm0J4DIjsfvIXjjwzmMtbRka0yEq--bygRhkiaeE1XGUBNXt7xJvDCVngDU Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Domain-Id: None Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Domain-Name: None Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Identity-Status: Confirmed Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Is-Admin-Project: True Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Project-Domain-Id: default Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Project-Domain-Name: Default Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Project-Id: 0e39050787a54caf815f78d2aa8ec514 Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Project-Name: admin Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Role: admin,member,reader Jul 18 16:43:58.368176 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Roles: admin,member,reader Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Tenant: admin Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Tenant-Id: 0e39050787a54caf815f78d2aa8ec514 Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Tenant-Name: admin Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User: admin Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User-Domain-Id: default Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User-Domain-Name: Default Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User-Id: c740c2989cfd4a19b4bb2520a5d2cbf7 Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User-Name: admin Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: method: > Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: exception: Flavor 42 could not be found. Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: action_args: {'id': '42'} Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:43:58.369915 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:58.370985 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:43:58.372368 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-f695b426-8b8a-478e-aa87-3c2655dc2cef admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:43:58.373669 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-f695b426-8b8a-478e-aa87-3c2655dc2cef admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.409326 Jul 18 16:43:58.373669 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 19/39] 10.222.0.76 () {60 vars in 1190 bytes} [Mon Jul 18 16:43:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:58.379213 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-89ea851f-0e8a-4cae-bfc6-b71bb70e0706 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:58.382116 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:58.402395 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-89ea851f-0e8a-4cae-bfc6-b71bb70e0706 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026596 Jul 18 16:43:58.402963 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 21/40] 10.222.0.76 () {60 vars in 1210 bytes} [Mon Jul 18 16:43:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:58.413142 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-4229dfce-0c6b-4ae3-a0e4-cf00e717e433 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:58.435832 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-4229dfce-0c6b-4ae3-a0e4-cf00e717e433 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026613 Jul 18 16:43:58.436374 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 20/41] 10.222.0.76 () {60 vars in 1210 bytes} [Mon Jul 18 16:43:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:43:58.447268 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-3532786a-1d25-4109-9f69-e67344beaffa admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:58.453338 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.wsgi [None req-3532786a-1d25-4109-9f69-e67344beaffa admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-3532786a-1d25-4109-9f69-e67344beaffa admin admin] Request method failure captured: Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Accept: application/json Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Accept-Encoding: gzip, deflate Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Connection: keep-alive Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Content-Length: 0 Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Host: 10.222.0.76 Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Openstack-Api-Version: compute 2.90 Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Openstack-System-Scope: None Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: User-Agent: python-novaclient Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Auth-Token: gAAAAABi1Y3NoT0V7GSbGbT2mDpvdAs1uh-yGqw9bcX745yFrvjbm9jRT7vSPTNYtgoANM4y28nPP2gv9XatR2wLmQov4jzIpJ8RwbUk083hooFIZNblf-r9MnE5nm0J4DIjsfvIXjjwzmMtbRka0yEq--bygRhkiaeE1XGUBNXt7xJvDCVngDU Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Domain-Id: None Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Domain-Name: None Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Identity-Status: Confirmed Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Is-Admin-Project: True Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Project-Domain-Id: default Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Project-Domain-Name: Default Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Project-Id: 0e39050787a54caf815f78d2aa8ec514 Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Project-Name: admin Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Role: admin,member,reader Jul 18 16:43:58.456664 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Roles: admin,member,reader Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Tenant: admin Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Tenant-Id: 0e39050787a54caf815f78d2aa8ec514 Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Tenant-Name: admin Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User: admin Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User-Domain-Id: default Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User-Domain-Name: Default Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User-Id: c740c2989cfd4a19b4bb2520a5d2cbf7 Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User-Name: admin Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: method: > Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: exception: Flavor 42 could not be found. Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: action_args: {'id': '42'} Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:43:58.458452 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:58.459695 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:43:58.464704 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-3532786a-1d25-4109-9f69-e67344beaffa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:43:58.467065 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-3532786a-1d25-4109-9f69-e67344beaffa admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015857 Jul 18 16:43:58.467065 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 22/42] 10.222.0.76 () {60 vars in 1190 bytes} [Mon Jul 18 16:43:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:59.478124 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-4229dfce-0c6b-4ae3-a0e4-cf00e717e433 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:59.479213 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-4229dfce-0c6b-4ae3-a0e4-cf00e717e433 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002102 Jul 18 16:43:59.479618 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 21/43] 10.222.0.76 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:00.026445 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-817a1117-5725-42f8-8b9a-c5eadc05ad3c admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:00.032352 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.wsgi [None req-817a1117-5725-42f8-8b9a-c5eadc05ad3c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-817a1117-5725-42f8-8b9a-c5eadc05ad3c admin admin] Request method failure captured: Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Accept: application/json Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Accept-Encoding: gzip, deflate Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Connection: keep-alive Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Content-Length: 0 Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Host: 10.222.0.76 Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Openstack-Api-Version: compute 2.90 Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Openstack-System-Scope: None Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: User-Agent: python-novaclient Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Auth-Token: gAAAAABi1Y3PWep8JKIFfZUdVw7UCVnQpz6Bld0WTKZA5MM5ZGdg02ElFvhHiRqfeyF4L1vANkyTmHXsi5_yt5zzx0T08TbItcSh4XWEK-5mb8jDpGTddCIqmPmPFDt1JlO42X9U7mn93VMLp5_txVYCUS5cvHymVO24Dfh97ARSU5WoMuBsCQw Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Domain-Id: None Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Domain-Name: None Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Identity-Status: Confirmed Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Is-Admin-Project: True Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Project-Domain-Id: default Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Project-Domain-Name: Default Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Project-Id: 0e39050787a54caf815f78d2aa8ec514 Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Project-Name: admin Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Role: admin,member,reader Jul 18 16:44:00.033906 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Roles: admin,member,reader Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Tenant: admin Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Tenant-Id: 0e39050787a54caf815f78d2aa8ec514 Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Tenant-Name: admin Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User: admin Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User-Domain-Id: default Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User-Domain-Name: Default Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User-Id: c740c2989cfd4a19b4bb2520a5d2cbf7 Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User-Name: admin Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: method: > Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: exception: Flavor 84 could not be found. Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: action_args: {'id': '84'} Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:44:00.035569 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:44:00.036541 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:44:00.037931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-817a1117-5725-42f8-8b9a-c5eadc05ad3c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:44:00.039226 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-817a1117-5725-42f8-8b9a-c5eadc05ad3c admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.414466 Jul 18 16:44:00.039226 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 23/44] 10.222.0.76 () {60 vars in 1190 bytes} [Mon Jul 18 16:43:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:00.045413 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-83791528-aa7b-4fff-954a-27c83a64e147 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:00.059724 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-83791528-aa7b-4fff-954a-27c83a64e147 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017867 Jul 18 16:44:00.060292 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 22/45] 10.222.0.76 () {60 vars in 1210 bytes} [Mon Jul 18 16:44:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:00.070253 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-8be114c4-a458-44e4-8440-7edeb59e831e admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:00.084764 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-8be114c4-a458-44e4-8440-7edeb59e831e admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018165 Jul 18 16:44:00.085347 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 24/46] 10.222.0.76 () {60 vars in 1210 bytes} [Mon Jul 18 16:44:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:44:00.095449 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-49dcae30-6fb7-4acd-9ecd-ea1ae28d63a3 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:00.100925 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.wsgi [None req-49dcae30-6fb7-4acd-9ecd-ea1ae28d63a3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-49dcae30-6fb7-4acd-9ecd-ea1ae28d63a3 admin admin] Request method failure captured: Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Accept: application/json Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Accept-Encoding: gzip, deflate Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Connection: keep-alive Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Content-Length: 0 Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Host: 10.222.0.76 Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Openstack-Api-Version: compute 2.90 Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Openstack-System-Scope: None Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: User-Agent: python-novaclient Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Auth-Token: gAAAAABi1Y3PWep8JKIFfZUdVw7UCVnQpz6Bld0WTKZA5MM5ZGdg02ElFvhHiRqfeyF4L1vANkyTmHXsi5_yt5zzx0T08TbItcSh4XWEK-5mb8jDpGTddCIqmPmPFDt1JlO42X9U7mn93VMLp5_txVYCUS5cvHymVO24Dfh97ARSU5WoMuBsCQw Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Domain-Id: None Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Domain-Name: None Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Identity-Status: Confirmed Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Is-Admin-Project: True Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Project-Domain-Id: default Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Project-Domain-Name: Default Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Project-Id: 0e39050787a54caf815f78d2aa8ec514 Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Project-Name: admin Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Role: admin,member,reader Jul 18 16:44:00.102686 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Roles: admin,member,reader Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Tenant: admin Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Tenant-Id: 0e39050787a54caf815f78d2aa8ec514 Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Tenant-Name: admin Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User: admin Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User-Domain-Id: default Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User-Domain-Name: Default Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User-Id: c740c2989cfd4a19b4bb2520a5d2cbf7 Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User-Name: admin Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: method: > Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: exception: Flavor 84 could not be found. Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: action_args: {'id': '84'} Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:44:00.104143 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:44:00.105061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:44:00.106512 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-49dcae30-6fb7-4acd-9ecd-ea1ae28d63a3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:44:00.107805 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-49dcae30-6fb7-4acd-9ecd-ea1ae28d63a3 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012308 Jul 18 16:44:00.107805 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 23/47] 10.222.0.76 () {60 vars in 1190 bytes} [Mon Jul 18 16:44:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:01.115081 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-8be114c4-a458-44e4-8440-7edeb59e831e admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:01.116087 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-8be114c4-a458-44e4-8440-7edeb59e831e admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 18 16:44:01.116483 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 25/48] 10.222.0.76 () {56 vars in 1074 bytes} [Mon Jul 18 16:44:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:01.661631 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-96bd1ca6-1e38-4ce8-a02a-27d0de5f8193 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:01.668581 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.wsgi [None req-96bd1ca6-1e38-4ce8-a02a-27d0de5f8193 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-96bd1ca6-1e38-4ce8-a02a-27d0de5f8193 admin admin] Request method failure captured: Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Accept: application/json Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Accept-Encoding: gzip, deflate Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Connection: keep-alive Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Content-Length: 0 Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Host: 10.222.0.76 Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Openstack-Api-Version: compute 2.90 Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Openstack-System-Scope: None Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: User-Agent: python-novaclient Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Auth-Token: gAAAAABi1Y3RPzsXcMcztvJxIhnlD0w38UvhhRKvMQkIcOwbDQ-YX0VyAOIS0WdK0R7MNG3rJUtbaZ6Q241oGbBv_d3_Q8Ir9F6SSPdZHQlHc1SicvZbODAJp_0hLLyq7gL69aOPtkn5c6RcOUW_MqyAp7nPMYI_srvx8N5M7Ne_aPgLoPGx8gk Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Domain-Id: None Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Domain-Name: None Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Identity-Status: Confirmed Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Is-Admin-Project: True Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Project-Domain-Id: default Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Project-Domain-Name: Default Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Project-Id: 0e39050787a54caf815f78d2aa8ec514 Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Project-Name: admin Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Role: admin,member,reader Jul 18 16:44:01.670106 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Roles: admin,member,reader Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Tenant: admin Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Tenant-Id: 0e39050787a54caf815f78d2aa8ec514 Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-Tenant-Name: admin Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User: admin Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User-Domain-Id: default Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User-Domain-Name: Default Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User-Id: c740c2989cfd4a19b4bb2520a5d2cbf7 Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: X-User-Name: admin Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: method: > Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: exception: Flavor 451 could not be found. Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: action_args: {'id': '451'} Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:44:01.671675 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:44:01.672697 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: ERROR nova.api.openstack.wsgi Jul 18 16:44:01.673825 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-96bd1ca6-1e38-4ce8-a02a-27d0de5f8193 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:44:01.675051 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-96bd1ca6-1e38-4ce8-a02a-27d0de5f8193 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.415050 Jul 18 16:44:01.675051 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 24/49] 10.222.0.76 () {60 vars in 1193 bytes} [Mon Jul 18 16:44:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:01.682228 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-130d0426-9b9d-4b77-8d4b-56b0f31ef3d9 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:01.696369 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-130d0426-9b9d-4b77-8d4b-56b0f31ef3d9 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018647 Jul 18 16:44:01.696942 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 26/50] 10.222.0.76 () {60 vars in 1210 bytes} [Mon Jul 18 16:44:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:01.706628 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:01.721584 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018514 Jul 18 16:44:01.722132 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 25/51] 10.222.0.76 () {60 vars in 1210 bytes} [Mon Jul 18 16:44:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:01.732382 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-3b3466df-ef2c-451a-8d41-e59ba921dbff admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:01.738310 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.wsgi [None req-3b3466df-ef2c-451a-8d41-e59ba921dbff admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-3b3466df-ef2c-451a-8d41-e59ba921dbff admin admin] Request method failure captured: Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Accept: application/json Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Accept-Encoding: gzip, deflate Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Connection: keep-alive Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Content-Length: 0 Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Host: 10.222.0.76 Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Openstack-Api-Version: compute 2.90 Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Openstack-System-Scope: None Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: User-Agent: python-novaclient Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Auth-Token: gAAAAABi1Y3RPzsXcMcztvJxIhnlD0w38UvhhRKvMQkIcOwbDQ-YX0VyAOIS0WdK0R7MNG3rJUtbaZ6Q241oGbBv_d3_Q8Ir9F6SSPdZHQlHc1SicvZbODAJp_0hLLyq7gL69aOPtkn5c6RcOUW_MqyAp7nPMYI_srvx8N5M7Ne_aPgLoPGx8gk Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Domain-Id: None Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Domain-Name: None Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Identity-Status: Confirmed Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Is-Admin-Project: True Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Project-Domain-Id: default Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Project-Domain-Name: Default Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Project-Id: 0e39050787a54caf815f78d2aa8ec514 Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Project-Name: admin Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Role: admin,member,reader Jul 18 16:44:01.739814 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Roles: admin,member,reader Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0e39050787a54caf815f78d2aa8ec514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Tenant: admin Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Tenant-Id: 0e39050787a54caf815f78d2aa8ec514 Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-Tenant-Name: admin Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User: admin Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User-Domain-Id: default Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User-Domain-Name: Default Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User-Id: c740c2989cfd4a19b4bb2520a5d2cbf7 Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: X-User-Name: admin Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: method: > Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: exception: Flavor 451 could not be found. Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: action_args: {'id': '451'} Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:44:01.742832 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:44:01.743855 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 18 16:44:01.744924 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-3b3466df-ef2c-451a-8d41-e59ba921dbff admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:44:01.746019 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-3b3466df-ef2c-451a-8d41-e59ba921dbff admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012394 Jul 18 16:44:01.746019 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 27/52] 10.222.0.76 () {60 vars in 1193 bytes} [Mon Jul 18 16:44:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:02.732252 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:02.733290 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 18 16:44:02.733749 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 26/53] 10.222.0.76 () {56 vars in 1074 bytes} [Mon Jul 18 16:44:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:03.293861 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-98ca522c-ed4e-402b-838a-e2938c116a9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:03.376031 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-98ca522c-ed4e-402b-838a-e2938c116a9e admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.502298 Jul 18 16:44:03.376580 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 28/54] 10.222.0.76 () {64 vars in 1235 bytes} [Mon Jul 18 16:44:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:44:04.373061 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:04.374073 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 18 16:44:04.374522 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 27/55] 10.222.0.76 () {56 vars in 1074 bytes} [Mon Jul 18 16:44:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:44:04.918511 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-7987bf3a-dbae-49b8-9554-cc43d087d502 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:05.004156 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-7987bf3a-dbae-49b8-9554-cc43d087d502 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.488972 Jul 18 16:44:05.004624 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 29/56] 10.222.0.76 () {64 vars in 1235 bytes} [Mon Jul 18 16:44:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:44:06.040285 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:06.041315 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jul 18 16:44:06.041709 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 28/57] 10.222.0.76 () {56 vars in 1074 bytes} [Mon Jul 18 16:44:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:06.571854 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-dbe77686-bc69-4662-a8aa-66ac683fef9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:06.647976 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-dbe77686-bc69-4662-a8aa-66ac683fef9c admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.466091 Jul 18 16:44:06.648937 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 30/58] 10.222.0.76 () {64 vars in 1235 bytes} [Mon Jul 18 16:44:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:44:07.656963 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:07.658001 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 18 16:44:07.658391 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 29/59] 10.222.0.76 () {56 vars in 1074 bytes} [Mon Jul 18 16:44:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:08.193960 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-2e55fe48-193a-4409-962f-96f1ad540ac6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:08.284087 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-2e55fe48-193a-4409-962f-96f1ad540ac6 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.485776 Jul 18 16:44:08.284648 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 31/60] 10.222.0.76 () {64 vars in 1235 bytes} [Mon Jul 18 16:44:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:44:09.392059 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:09.393142 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001920 Jul 18 16:44:09.393544 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 30/61] 10.222.0.76 () {56 vars in 1074 bytes} [Mon Jul 18 16:44:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:09.957459 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-5dbf18bd-0b6d-4ecb-be22-fcec12457eca admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:09.976892 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-5dbf18bd-0b6d-4ecb-be22-fcec12457eca admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.445139 Jul 18 16:44:09.977451 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 32/62] 10.222.0.76 () {60 vars in 1202 bytes} [Mon Jul 18 16:44:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:45:02.602853 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:02.603770 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-54c888af-111e-42f6-b556-7110dd990ce2 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 18 16:45:02.604175 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 31/63] 10.222.0.76 () {54 vars in 930 bytes} [Mon Jul 18 16:45:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:02.615102 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:03.018843 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-3666022d-d462-41aa-8321-9d23bb058f92 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:03.041373 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-3666022d-d462-41aa-8321-9d23bb058f92 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.430814 Jul 18 16:45:03.041995 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 33/64] 10.222.0.76 () {60 vars in 1291 bytes} [Mon Jul 18 16:45:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:45:03.068535 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG dbcounter [-] [110319] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:03.072422 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-e86b9ded-1d3e-4e94-975b-f29214ce72fe admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:03.080196 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-e86b9ded-1d3e-4e94-975b-f29214ce72fe admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013918 Jul 18 16:45:03.080749 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 32/65] 10.222.0.76 () {60 vars in 1282 bytes} [Mon Jul 18 16:45:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:03.093072 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-9de1e65a-98dc-4049-96cf-fb71878e4322 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:03.101124 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-9de1e65a-98dc-4049-96cf-fb71878e4322 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011999 Jul 18 16:45:03.101688 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 34/66] 10.222.0.76 () {60 vars in 1285 bytes} [Mon Jul 18 16:45:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:03.114461 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-08f3e2e8-b87b-44e5-99d8-d1a81900e9ce admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:03.122273 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-08f3e2e8-b87b-44e5-99d8-d1a81900e9ce admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012543 Jul 18 16:45:03.122816 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 33/67] 10.222.0.76 () {60 vars in 1285 bytes} [Mon Jul 18 16:45:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:03.135203 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-8668ebb6-4837-4641-a8f0-a2ed0fe3bc15 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:03.142950 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-8668ebb6-4837-4641-a8f0-a2ed0fe3bc15 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011381 Jul 18 16:45:03.143480 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 35/68] 10.222.0.76 () {60 vars in 1282 bytes} [Mon Jul 18 16:45:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:56.671813 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-08f3e2e8-b87b-44e5-99d8-d1a81900e9ce admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:56.672853 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-08f3e2e8-b87b-44e5-99d8-d1a81900e9ce admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 18 16:48:56.673405 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 34/69] 10.222.0.76 () {56 vars in 1074 bytes} [Mon Jul 18 16:48:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:48:56.820312 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_api:SELECT=6 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:56.991624 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-3f2a4a61-0577-40c6-af89-0ae40c01247a admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:56.992841 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:48:56.992841 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: warnings.warn(msg) Jul 18 16:48:56.994312 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-3f2a4a61-0577-40c6-af89-0ae40c01247a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:56.994755 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-3f2a4a61-0577-40c6-af89-0ae40c01247a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:56.995536 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-3f2a4a61-0577-40c6-af89-0ae40c01247a admin admin] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:56.995962 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-3f2a4a61-0577-40c6-af89-0ae40c01247a admin admin] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:57.038230 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-3f2a4a61-0577-40c6-af89-0ae40c01247a admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.219264 Jul 18 16:48:57.038931 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 36/70] 10.222.0.76 () {60 vars in 1193 bytes} [Mon Jul 18 16:48:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:48:57.932818 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-08f3e2e8-b87b-44e5-99d8-d1a81900e9ce admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:57.934580 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-08f3e2e8-b87b-44e5-99d8-d1a81900e9ce admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002621 Jul 18 16:48:57.935028 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 35/71] 10.222.0.76 () {56 vars in 1074 bytes} [Mon Jul 18 16:48:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:58.140585 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-0881aeb2-7feb-48d5-b61f-0093222c03f8 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:58.141794 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:48:58.141794 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: warnings.warn(msg) Jul 18 16:48:58.143006 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-0881aeb2-7feb-48d5-b61f-0093222c03f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:58.143449 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-0881aeb2-7feb-48d5-b61f-0093222c03f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:58.144775 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-0881aeb2-7feb-48d5-b61f-0093222c03f8 admin admin] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:58.145242 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-0881aeb2-7feb-48d5-b61f-0093222c03f8 admin admin] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:58.165409 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-0881aeb2-7feb-48d5-b61f-0093222c03f8 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.086685 Jul 18 16:48:58.165990 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 37/72] 10.222.0.76 () {60 vars in 1193 bytes} [Mon Jul 18 16:48:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:49:09.451689 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-08f3e2e8-b87b-44e5-99d8-d1a81900e9ce admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:09.452765 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-08f3e2e8-b87b-44e5-99d8-d1a81900e9ce admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Jul 18 16:49:09.453201 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 36/73] 10.222.0.76 () {56 vars in 1074 bytes} [Mon Jul 18 16:49:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:49:09.602327 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_cell0:SELECT=4 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:09.603122 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_cell1:SELECT=4 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:09.603731 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_api:SELECT=8 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:09.653305 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-6a63dc62-473d-4051-97bf-ec8903556b7b admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:09.658824 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:49:09.658824 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: warnings.warn(msg) Jul 18 16:49:09.658824 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-6a63dc62-473d-4051-97bf-ec8903556b7b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:09.658824 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-6a63dc62-473d-4051-97bf-ec8903556b7b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:09.658824 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-6a63dc62-473d-4051-97bf-ec8903556b7b admin admin] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:09.658824 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-6a63dc62-473d-4051-97bf-ec8903556b7b admin admin] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:09.682405 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-6a63dc62-473d-4051-97bf-ec8903556b7b admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084979 Jul 18 16:49:09.687679 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 38/74] 10.222.0.76 () {60 vars in 1193 bytes} [Mon Jul 18 16:49:09 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:49:10.551175 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: DEBUG nova.api.openstack.wsgi [None req-08f3e2e8-b87b-44e5-99d8-d1a81900e9ce admin admin] Calling method '>' {{(pid=110319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:10.553103 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: INFO nova.api.openstack.requestlog [None req-08f3e2e8-b87b-44e5-99d8-d1a81900e9ce admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002604 Jul 18 16:49:10.553896 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: [pid: 110319|app: 0|req: 37/75] 10.222.0.76 () {56 vars in 1074 bytes} [Mon Jul 18 16:49:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:49:10.763018 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-28d670e1-32e7-4e68-8d91-ee9cfbeee625 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:10.764229 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:49:10.764229 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: warnings.warn(msg) Jul 18 16:49:10.765436 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-28d670e1-32e7-4e68-8d91-ee9cfbeee625 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:10.765968 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-28d670e1-32e7-4e68-8d91-ee9cfbeee625 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:10.766737 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-28d670e1-32e7-4e68-8d91-ee9cfbeee625 admin admin] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:10.767188 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-28d670e1-32e7-4e68-8d91-ee9cfbeee625 admin admin] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:10.791294 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-28d670e1-32e7-4e68-8d91-ee9cfbeee625 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082296 Jul 18 16:49:10.791863 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 39/76] 10.222.0.76 () {60 vars in 1193 bytes} [Mon Jul 18 16:49:10 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:50:17.933242 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: Mon Jul 18 16:50:17 2022 - graceful shutdown triggered... Jul 18 16:50:17.933001 dv-cinder-837542-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 16:50:17.934223 dv-cinder-837542-6-iscsi devstack@n-api.service[110318]: Gracefully killing worker 1 (pid: 110318)... Jul 18 16:50:17.934587 dv-cinder-837542-6-iscsi devstack@n-api.service[110319]: Gracefully killing worker 2 (pid: 110319)... Jul 18 16:50:18.933548 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: worker 1 buried after 1 seconds Jul 18 16:50:18.934292 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: worker 2 buried after 1 seconds Jul 18 16:50:18.934292 dv-cinder-837542-6-iscsi devstack@n-api.service[110317]: goodbye to uWSGI. Jul 18 16:50:18.935404 dv-cinder-837542-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 18 16:50:18.936676 dv-cinder-837542-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 16:50:18.939553 dv-cinder-837542-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 16:50:18.951440 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 16:50:18.954366 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 16:50:18 2022] *** Jul 18 16:50:18.954530 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 16:50:18.954661 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 16:50:18.954781 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: nodename: dv-cinder-837542-6-iscsi Jul 18 16:50:18.954924 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: machine: x86_64 Jul 18 16:50:18.955033 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: clock source: unix Jul 18 16:50:18.955139 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: pcre jit disabled Jul 18 16:50:18.955259 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: detected number of CPU cores: 4 Jul 18 16:50:18.955366 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: current working directory: / Jul 18 16:50:18.955509 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: detected binary path: /usr/bin/uwsgi-core Jul 18 16:50:18.955669 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: your processes number limit is 47680 Jul 18 16:50:18.955802 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: your memory page size is 4096 bytes Jul 18 16:50:18.955802 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: detected max file descriptor number: 2048 Jul 18 16:50:18.955802 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: lock engine: pthread robust mutexes Jul 18 16:50:18.956074 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: thunder lock: enabled Jul 18 16:50:18.956148 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 16:50:18.956218 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 16:50:19.010638 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: Python main interpreter initialized at 0x556d758729c0 Jul 18 16:50:19.010638 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: python threads support enabled Jul 18 16:50:19.010638 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: your server socket listen backlog is limited to 100 connections Jul 18 16:50:19.010638 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: your mercy for graceful operations on workers is 90 seconds Jul 18 16:50:19.011094 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 16:50:19.011094 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: *** Operational MODE: preforking *** Jul 18 16:50:19.011393 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: *** uWSGI is running in multiple interpreter mode *** Jul 18 16:50:19.011393 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: spawned uWSGI master process (pid: 124849) Jul 18 16:50:19.015350 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: spawned uWSGI worker 1 (pid: 124867, cores: 1) Jul 18 16:50:19.015350 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: spawned uWSGI worker 2 (pid: 124868, cores: 1) Jul 18 16:50:19.015350 dv-cinder-837542-6-iscsi devstack@n-api.service[124849]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 16:50:19.011588 dv-cinder-837542-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 16:50:19.683324 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:50:19.712910 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:50:20.871729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:50:20.871729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: from cryptography.utils import int_from_bytes Jul 18 16:50:20.872553 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:50:20.872553 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: from cryptography.utils import int_from_bytes Jul 18 16:50:20.943942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:50:20.943942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: from cryptography.utils import int_from_bytes Jul 18 16:50:20.944560 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:50:20.944560 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: from cryptography.utils import int_from_bytes Jul 18 16:50:23.210485 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:50:23.211069 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:50:23.211279 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:50:23.211659 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:50:23.220846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:50:23.220846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.220846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.220846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.220846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.220846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.220846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.220846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.221760 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.221760 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.221760 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.221760 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.221760 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-6-iscsi {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.221760 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.221760 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.221760 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.222677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.223213 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.223213 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-6-iscsi {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.223213 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.223213 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.223213 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.223535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.224389 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.224389 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.224720 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.225069 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.225393 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.225750 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.226072 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.226577 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.227088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.227405 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.227722 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.228064 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.228393 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.228708 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.229027 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.229295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.229614 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.229947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.230279 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.230613 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.230874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.231136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.231464 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.231794 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.232110 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.232428 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.232851 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.233429 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.233727 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.234049 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.234368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.234685 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.235014 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.235341 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.235676 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.235995 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.236331 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.236751 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.237046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.237574 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.237695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.238018 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.238338 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.238666 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.239317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.239317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.239652 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.239916 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.240339 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.240709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.240908 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.241168 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.241561 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.241783 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.242113 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.242425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.242746 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.243061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.243371 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.243685 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.244186 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.244350 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.244970 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.244970 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.245450 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.245611 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.245877 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.246200 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.248229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.248229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.248229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.248229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.248229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.248229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.249896 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.249896 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.249896 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.249896 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.250475 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.250475 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.250787 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.251109 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.251429 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.251757 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.252075 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.252386 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.252718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.253064 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.253371 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.253681 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.253997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.254313 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.254633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.254948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.255260 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.255566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.255898 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.256232 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.256552 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.256872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.257211 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.257540 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.257891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.258233 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.258590 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.258913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.259282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.259592 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.259922 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.260245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.260570 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.260908 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.261257 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.261580 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.261907 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.262222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.262550 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.262887 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.263215 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.263543 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.263870 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.264852 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.265207 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.265602 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.265886 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.266219 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.266562 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.266917 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.267241 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.267576 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.267909 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.268231 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.268562 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.268875 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.269226 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.269572 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.269888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.270213 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.270532 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.270852 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.271172 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.271491 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.271813 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.272159 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.272529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.272807 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.273166 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.273466 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.273785 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.274104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.274421 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.274755 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.275031 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.275344 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.275661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.275978 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.276307 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.276644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.276958 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.277425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.277630 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.277949 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.278267 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.278585 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.278931 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.279216 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.279643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.280054 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.280390 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.280711 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.281055 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.281467 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.281696 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.282010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.282333 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.282679 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.282962 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.283274 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.283594 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.283928 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.284250 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.284570 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.284914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.285297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.285613 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.285950 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.286285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.286701 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.286929 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.287247 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.287560 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.287872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.288184 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.289515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.289515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.289515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.289515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.290223 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.290223 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.290516 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.290673 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.290981 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.291294 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.291607 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.291980 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.292267 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.292571 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:50:23.293292 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.293453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:50:23.293601 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.293601 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.293894 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:50:23.294046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.294216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:50:23.294364 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.294519 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:50:23.294673 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.294817 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.294970 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.295130 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.295340 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.295497 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.295660 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.295811 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.295970 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.295970 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.296328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.296512 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.296667 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.296925 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.297114 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.297266 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.297410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.297554 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.297697 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.297853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.298011 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.298159 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.298314 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.298468 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.298611 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-6-iscsi {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.298765 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.298917 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.299073 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.299224 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.299224 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.299498 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.299754 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.299936 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.300178 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.300337 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.300502 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.300659 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.300825 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.300985 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.300985 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.301299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.301464 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.301640 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.301875 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.302051 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.302287 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.302451 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.302772 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.302943 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.303091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.303447 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.303602 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.303755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.303901 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.304056 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.304203 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.304355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.304518 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.304677 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.304841 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.304987 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.305170 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.305318 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-6-iscsi {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.305465 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.305616 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.305761 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.305920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.306066 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.306218 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.306371 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.306371 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.306654 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.306654 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.307660 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.307818 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.307965 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.308118 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.308275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.308421 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.308569 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.308730 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.308884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.308884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.309303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.309478 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.309635 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.309889 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.310049 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.310300 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.310610 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.310756 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.311503 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.311724 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.312156 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.312435 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.312591 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.312936 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.313139 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.313299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.313741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.313914 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.313914 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.314194 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.314347 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.314501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.314656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.314803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.314948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.315102 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.315265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.315429 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.315575 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.315722 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.315876 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.316034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.316180 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.316335 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.316481 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.316637 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.316790 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.316955 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.317295 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.317482 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.317737 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.317911 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.318059 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.318213 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.318368 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.318543 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.318892 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.318892 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.319187 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.319339 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.319511 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.319659 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.319812 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.320076 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.320231 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.320487 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.320650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.320805 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.320952 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.321182 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.321343 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.321515 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.321783 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.321968 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.322234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.322414 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.322661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.322822 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.323169 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.323321 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.323467 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.323630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.324020 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.324179 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.324336 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.324501 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.324655 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.324809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.324954 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.325141 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.325290 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.325436 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.325588 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.325741 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.325898 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.326052 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.326200 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.326344 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.326535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.327209 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.327209 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.327554 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.327720 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.327965 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.328115 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.328262 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.328415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.328563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.328716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.328716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.329022 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.329188 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.329361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.329509 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.329655 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.329807 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.329962 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.330226 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.330393 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.330648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.330816 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.330972 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.331129 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.331274 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.331430 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.331574 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.331720 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.331877 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.332032 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.332415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.332576 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.332815 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.332968 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.333319 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.333512 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.333669 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.333847 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.334199 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.334362 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.334523 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.334679 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.334826 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.334992 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.335138 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.335282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.335426 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.335570 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.335725 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.335881 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.336039 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.336184 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.336335 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.336488 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.336642 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.336788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.336934 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.337131 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.337290 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.337445 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.337601 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.337754 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.337899 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.338153 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.338305 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.338467 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.338624 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.338780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.338925 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.338925 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.339227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.339382 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.339536 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.339682 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.339827 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.339972 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.340135 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.340395 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.340557 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.340799 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.340953 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.341138 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.341295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.341449 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.341595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.341738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.341892 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.342044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.342247 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.342748 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.342997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.343159 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.343327 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.343561 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.343800 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.343949 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.344115 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.344370 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:50:23.344531 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.344685 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.344950 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.345181 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.345352 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.345507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.345658 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.345803 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.345959 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.346105 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.346259 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.346413 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.346566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.346711 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.346870 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.347016 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.347171 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.347316 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.347468 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.347622 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.347776 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.347921 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.348075 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.348333 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.348496 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.348652 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.349081 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.349234 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.349389 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.349548 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.349704 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.349858 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.350005 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.350149 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.350301 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.350547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.350701 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.350965 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.351119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.351546 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.351696 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.351859 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.352019 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.352166 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.352319 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.352463 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.352782 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.353238 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.353412 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.353577 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.353803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.353961 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.354108 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.354261 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.354535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.354697 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.354853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.355106 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.355266 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.355427 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.355591 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.355746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.355892 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.356043 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.356189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.356342 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.356496 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.356659 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.356813 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.356958 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.357142 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.357302 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.357449 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.357601 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.357815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.357980 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.358147 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.358326 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.358556 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.358707 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.358872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.359018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.359170 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.359324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.359470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.359614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.359765 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.359918 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.360079 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.360225 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.360369 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.360532 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.360776 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.360949 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.361208 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.361369 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.361524 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.361678 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.361830 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.361983 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.362144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.362291 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.362436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.362592 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.362905 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.363077 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.363252 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.363472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.363623 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.363785 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.364015 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.364169 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.364319 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.364411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.364563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.364789 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.364932 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.365127 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.365362 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.365497 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.365635 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.365765 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.365903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.366049 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.366188 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.366319 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.366319 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.366581 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.366719 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.366859 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.366997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.366997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.367244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.367374 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.367502 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.367641 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.367786 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.367939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.368079 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.368210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.368357 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.368488 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.369332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.369468 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.369600 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.369743 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.369887 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.370028 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.370160 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.370298 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.370432 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.370561 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.370762 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.370988 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.371122 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.371355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.371491 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.371631 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.371762 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.371900 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.372031 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.372031 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.372284 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.372429 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.372562 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.372562 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.372562 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.373192 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.374220 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.374220 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.374522 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.374656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.374656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.374656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.374656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.375381 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.375626 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.375626 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.375626 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.375626 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.376131 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.376269 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.376269 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.376269 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.376642 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.376772 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.376772 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.376772 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.377215 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.377347 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.377347 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.377347 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.377734 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.377865 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.377865 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.377865 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.378503 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.378637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.378637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.378637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.378637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.378637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.379453 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.379599 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.379730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.379870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.379870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.379870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.380253 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.380394 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.380394 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.380394 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.380821 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.380991 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.380991 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.380991 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.380991 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.381815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.381946 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.381946 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.381946 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.382326 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.382466 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.382466 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.382721 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.382858 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.382858 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.383331 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.383464 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.383464 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.383729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.383860 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.383860 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.384148 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.384460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.384460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.384712 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.384841 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.384982 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.385169 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.385169 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.385549 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.385983 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.385983 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.386337 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.386471 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.386601 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.386739 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.386739 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.386984 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.387122 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.387262 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.387401 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.387401 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.387678 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.387826 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.387966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.388104 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.388104 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.388367 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.388497 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.388654 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.388795 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.389124 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.389262 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.389262 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.389603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.389827 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.389827 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.390229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.390417 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.390417 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.390693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.390826 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.390826 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.391089 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.391236 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.391236 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.391720 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.391856 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.391856 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.392103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.392232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.392362 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.392506 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.392646 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.392784 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.392784 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.393142 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.393481 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.393481 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.393758 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.393889 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.393889 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.394134 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.394265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.394265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.394727 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.394868 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.395009 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.395144 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.395144 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.395425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.395675 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.395820 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.395951 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.395951 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.396351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.396484 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.396484 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.396740 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.396872 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.397054 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.397207 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.397207 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.397474 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.397613 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.397754 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.397884 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.397884 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.398154 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.398293 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.398293 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.398550 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.398695 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.398695 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.398961 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.399198 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.399343 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.399482 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.399627 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.399767 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.399898 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.400195 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.400413 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.400689 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.400839 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.401105 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.401244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.401524 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.401685 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.401909 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.402048 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.402186 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.402399 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.402540 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.402735 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.402939 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.403075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.403415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.403643 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.403788 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.403919 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.404059 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.404272 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.404406 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.405264 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.405560 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.405719 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.405940 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.406339 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.406484 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.406632 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.406765 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.407007 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.407142 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.407293 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.407426 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.407610 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.407745 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.408007 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.408141 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.408319 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.408528 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.408676 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.408932 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.409090 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.409458 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.409603 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.409742 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.409888 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.410120 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.410267 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.410494 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.410637 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.410843 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.411069 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.411202 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.411482 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.411637 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.411868 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.412093 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.412229 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.412414 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.412550 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.412737 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.412891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.413075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.413387 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.413634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.413837 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.413979 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.414121 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.414289 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.414433 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.414598 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.414792 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.414935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.415206 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.415483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.415620 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.415751 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.415889 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.416119 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.416264 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.416413 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.417340 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.417583 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.417743 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.417884 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.417884 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.418141 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.418300 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.418300 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.418558 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.418711 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.418843 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.418972 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.419111 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.419249 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.419499 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.419655 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.419797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.419942 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.420074 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.420458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.420664 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.420855 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.421148 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.421310 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.421534 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.421772 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.422021 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.422270 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.422407 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.422547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.422680 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.422811 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.423023 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.423166 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.423334 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.423660 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.423820 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.424047 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.424189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.424319 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.424537 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.424683 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.424851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.425096 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.425290 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.425609 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.425769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.425912 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.426052 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.426318 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.426463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.426617 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.426878 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.427022 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.427155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.427354 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.427498 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.427700 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.427874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.428016 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.428309 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.428456 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.428618 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.428852 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.428996 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.429379 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.429560 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.430008 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.430145 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.430288 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.430428 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.430560 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.430560 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.430832 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.430971 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.431260 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.431402 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.431535 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.431664 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.431818 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.431993 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.432313 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.432470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.432603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.432733 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.432889 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.433048 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.433196 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.433330 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.433536 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.433666 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.433849 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.433972 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.434166 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.434345 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.434552 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.434781 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.434898 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.435117 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.435229 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.435440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.435548 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.435766 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.435923 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.436258 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.436357 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.436579 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.436687 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.436988 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.437129 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.437387 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.437487 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.437713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.437813 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.438354 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.438434 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.438507 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.438580 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.438663 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.438745 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.438983 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.439136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.439294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.439443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.439605 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.439756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.439914 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.440063 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.440211 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.440359 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.440513 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.440670 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.440829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.440985 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.441173 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.441333 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.441566 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.441719 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.441866 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.442014 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.442170 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.442329 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.442477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.442625 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.442792 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.442949 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.443096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.443253 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.443400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.443547 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.443693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.443850 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.444004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.444129 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.444243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.444364 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.444486 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.444671 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.444840 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.444974 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.459637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.459860 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.460022 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.460137 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.460255 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.460346 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.460443 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.460531 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.460624 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.460718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.460813 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.460910 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.460996 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.462197 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.462318 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.462318 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.462501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.462604 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.462703 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.462790 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.462884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.462979 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.463076 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.463170 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.463257 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.463350 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.463438 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.463532 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.463626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.463712 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.463798 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.463882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.463967 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.464060 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.464148 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.464227 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.464331 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.464428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.464524 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.464618 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.464705 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.464790 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.464875 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.464959 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.466283 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.466440 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.466580 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.466715 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.466847 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.466981 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.467143 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.468033 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.468033 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.468237 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.468393 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.468507 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.468596 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.468680 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.468764 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.468850 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.468934 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.469049 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.469151 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.469246 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.469339 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.469425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.469517 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.469612 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.469699 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.469791 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.469886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.470026 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.470116 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.470277 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.470372 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.470456 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.470530 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.470616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.470708 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.470795 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.470886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.470972 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.471056 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.471147 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.471241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.471329 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.471329 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.471491 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.471583 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.471726 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.471826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.471912 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.471996 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.472087 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.472173 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.472274 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.472370 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.472464 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.472559 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.472769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.472866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.473033 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.473184 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.473349 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.473449 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.473542 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.473629 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.473988 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.474244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.474352 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.474449 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.474543 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.474629 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.474722 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.474818 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.474904 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.475056 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.475056 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.475318 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.475471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.475612 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.475612 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.475827 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.475914 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.475998 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.475998 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.476168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.476386 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.476483 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.476579 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.476680 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.476768 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.476861 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.476948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.477060 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.477163 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.477260 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.477355 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.477438 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.477519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.477592 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.477665 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.477795 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.477795 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.478054 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.478265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.478394 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.478517 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.478632 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.478752 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.478873 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.478994 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.479115 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.479241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.479356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.479476 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.479591 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.479694 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.479783 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.479783 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.483890 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.484013 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.484103 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.484249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.484355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.484459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.484547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.484641 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.484742 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.484844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.484938 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.485049 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.485137 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.485236 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.485332 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.485427 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.485527 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.485622 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.485709 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.485794 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.485886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.486030 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.486132 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.486221 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.486314 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.486546 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.486651 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.486748 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.486849 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.486937 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.487030 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.487124 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.487220 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.487220 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.487401 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.487486 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.487579 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.487673 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.487767 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.487861 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.487948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.488032 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.488133 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.488133 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.488306 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.488402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.488488 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.488580 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.488666 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.488772 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.488878 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.488973 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.489086 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.489162 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.489235 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.489235 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.489434 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.489531 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.489619 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.489713 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.489808 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.489903 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.490003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.490099 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.490188 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.490273 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.490358 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.490438 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.490531 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.490531 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.490696 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.490789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.490875 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.490973 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.491060 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.491152 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.491239 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.491325 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.491409 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.491502 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.491596 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.491682 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.491773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.491866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.491953 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.492049 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.492141 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.492235 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.492327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.492414 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.492506 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.492595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.492684 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.492770 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.492861 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.492979 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.492979 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.493170 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.493257 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.493351 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.493439 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.493525 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.493525 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.493693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.493778 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.493872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.493872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.494052 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.494153 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.494258 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.494355 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.494449 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.494543 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.494647 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.494785 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.494882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.494974 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.495074 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.495181 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.495278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.495374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.495461 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.495548 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.495633 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.495728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.495816 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.496076 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.496227 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.496321 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.496456 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.496691 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.496789 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.496926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.497163 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.497302 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.497391 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.497494 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.497589 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.497677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.497761 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.497903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.498009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.498112 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.498212 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.498310 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.498452 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.498552 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.498657 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.498746 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.498839 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.498926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.499011 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.499103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.499198 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.499294 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.499389 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.499475 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.499475 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.499688 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.499790 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.499889 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.500016 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.500128 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.500231 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.500327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.500415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.500549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.500649 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.500729 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.500846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.500948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.501066 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.501164 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.501263 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.501351 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.501436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.501534 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.501623 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.501766 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.501858 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.501952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.502045 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.502251 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.502348 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.502442 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.502529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.502613 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.502696 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.502830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.502926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.503011 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.503085 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.503217 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.503324 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.503459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.503591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.503778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.503987 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.504105 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.504237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.504388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.504570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.504706 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.504900 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.505037 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.505252 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.505376 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.505566 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.505710 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.505897 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.506006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.506221 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.506433 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.506640 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.506790 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.506931 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.507099 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.507242 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.507392 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.507598 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.507749 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.507903 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.508041 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.508123 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.508306 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.508456 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.508622 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.508731 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.508931 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.509143 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.509250 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:50:23.509427 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.509705 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.510019 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.510330 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.510641 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.510960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.511273 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.511609 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.511921 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.512231 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.512549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.512886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.513216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.513536 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.513849 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.514774 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.515095 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.515457 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.515789 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.516097 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.516408 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.516736 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.517083 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.517418 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.517766 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.518145 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.518431 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.518759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.519349 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.519695 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.520026 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.520381 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.520718 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.521208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.525614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.525614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.525614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.525614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.525614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.525614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.525614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.525614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.526311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.526311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.526311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.526311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.526311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.526311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.526311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.526311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.526860 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.526860 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.527002 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.527291 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.527561 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.527885 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.528205 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.528526 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.528842 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.529191 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.529514 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.530464 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.530796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.531112 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.531567 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.531891 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.532231 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.532550 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.532866 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.533243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.533576 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.533896 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.534226 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.534543 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.534881 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.535265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.535604 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.535939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.536255 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.536568 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.536883 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.537235 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.537572 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.537891 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.538204 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.538515 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.538833 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.539152 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.539464 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.539777 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.540087 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.540430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.540740 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.541080 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.541393 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.541701 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.542011 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.542399 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.542630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.542965 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.543249 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.543558 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.543868 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.544178 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.544528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.544869 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.545260 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.545812 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.546490 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.546490 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.546668 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.546920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.547246 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.547576 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.547892 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.548232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.548551 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.548872 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.549227 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.549547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.549865 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.550185 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.550526 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.550859 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.551235 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.551572 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.551900 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.552231 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.552564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.552883 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.553253 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.553576 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.553897 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.554218 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.554592 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.557055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.557055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.557055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.557055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.557055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.557055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.557055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.560529 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.560529 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.560529 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.560529 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.560529 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.560529 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.560529 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.560529 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.561120 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.561120 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.561120 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:50:23.561120 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:50:23.668935 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO dbcounter [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] Registered counter for database nova_api Jul 18 16:50:23.691520 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_db.sqlalchemy.engines [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:50:23.698729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writer thread running {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:50:23.716736 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO dbcounter [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] Registered counter for database nova_api Jul 18 16:50:23.737813 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_db.sqlalchemy.engines [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:50:23.744635 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writer thread running {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:50:23.758036 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.context [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c0091633-bf58-44a7-8bf2-495d496559e2(cell1) {{(pid=124868) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:50:23.762207 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.763908 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:23.764765 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.766768 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:23.768767 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO dbcounter [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] Registered counter for database nova_cell0 Jul 18 16:50:23.772832 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO dbcounter [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] Registered counter for database nova_cell1 Jul 18 16:50:23.780868 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_db.sqlalchemy.engines [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:50:23.784207 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_db.sqlalchemy.engines [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:50:23.790905 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writer thread running {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:50:23.796575 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writer thread running {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:50:23.807447 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.context [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c0091633-bf58-44a7-8bf2-495d496559e2(cell1) {{(pid=124867) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:50:23.811999 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.813614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:23.814446 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.816461 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:23.818496 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO dbcounter [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] Registered counter for database nova_cell0 Jul 18 16:50:23.822545 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO dbcounter [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] Registered counter for database nova_cell1 Jul 18 16:50:23.830169 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_db.sqlalchemy.engines [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:50:23.832265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_db.sqlalchemy.engines [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:50:23.838465 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writer thread running {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:50:23.841108 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writer thread running {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:50:23.945700 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO dbcounter [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] Registered counter for database nova_cell0 Jul 18 16:50:23.953503 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_db.sqlalchemy.engines [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:50:23.958506 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writer thread running {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:50:23.993180 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO dbcounter [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] Registered counter for database nova_cell0 Jul 18 16:50:24.002091 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_db.sqlalchemy.engines [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:50:24.010401 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writer thread running {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:50:24.284302 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: WARNING keystonemiddleware.auth_token [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:50:24.292815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: WARNING keystonemiddleware.auth_token [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:50:24.357117 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: WARNING keystonemiddleware.auth_token [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:50:24.365339 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: WARNING keystonemiddleware.auth_token [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:50:24.640885 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: WARNING keystonemiddleware.auth_token [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:50:24.647466 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: WARNING keystonemiddleware.auth_token [None req-02f55534-d9fa-40ba-933c-73cb405feb31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:50:24.652954 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556d758729c0 pid: 124868 (default app) Jul 18 16:50:24.726904 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: WARNING keystonemiddleware.auth_token [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:50:24.733713 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: WARNING keystonemiddleware.auth_token [None req-a5e5f0c1-dc8e-44f9-a9b6-6252abe65579 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:50:24.739330 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556d758729c0 pid: 124867 (default app) Jul 18 16:51:09.319446 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=3 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:09.321513 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=3 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:09.323188 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=3 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:09.324207 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=3 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:11.167021 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-31ed2308-8e36-4d9a-894c-86f482b2cf02 tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] Action: 'create', calling method: .version_select at 0x7f4af35b18b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-939999978", "metadata": {"Type": "work"}}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:12.985528 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-31ed2308-8e36-4d9a-894c-86f482b2cf02 tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.671028 Jul 18 16:51:12.985528 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 1/1] 10.222.0.76 () {60 vars in 1155 bytes} [Mon Jul 18 16:51:09 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3673 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 16:51:13.257849 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2473ff57-a972-4d8d-8bc7-45da18b9ff9b tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] Calling method '.version_select at 0x7f4af35f5280>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:13.344248 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:13.356266 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:13.357446 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:13.358367 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:14.661179 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2473ff57-a972-4d8d-8bc7-45da18b9ff9b tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/630921dc-e8cc-493c-b19d-aabd05ab79a9" status: 200 len: 352 microversion: 2.1 time: 1.671836 Jul 18 16:51:14.666429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 1/2] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 16:51:12 2022] GET /compute/v2.1/os-volumes/630921dc-e8cc-493c-b19d-aabd05ab79a9 => generated 352 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:15.676410 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9da37c27-5079-4635-b223-d092c47a7222 tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] Calling method '.version_select at 0x7f4af3479700>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:15.941525 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9da37c27-5079-4635-b223-d092c47a7222 tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/630921dc-e8cc-493c-b19d-aabd05ab79a9" status: 200 len: 353 microversion: 2.1 time: 0.269774 Jul 18 16:51:15.949028 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 2/3] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 16:51:15 2022] GET /compute/v2.1/os-volumes/630921dc-e8cc-493c-b19d-aabd05ab79a9 => generated 353 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:15.958962 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e32a3534-746f-4738-9073-368773a09609 tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] Calling method '.version_select at 0x7f4af34be790>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:16.073397 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e32a3534-746f-4738-9073-368773a09609 tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/630921dc-e8cc-493c-b19d-aabd05ab79a9" status: 200 len: 353 microversion: 2.1 time: 0.122497 Jul 18 16:51:16.074691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 2/4] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 16:51:15 2022] GET /compute/v2.1/os-volumes/630921dc-e8cc-493c-b19d-aabd05ab79a9 => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:51:16.092548 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4272a5ec-318d-414c-9cf2-238133d383e6 tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] Calling method '.version_select at 0x7f4af3479940>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:16.437719 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4272a5ec-318d-414c-9cf2-238133d383e6 tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/630921dc-e8cc-493c-b19d-aabd05ab79a9" status: 202 len: 0 microversion: 2.1 time: 0.348334 Jul 18 16:51:16.444290 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 3/5] 10.222.0.76 () {58 vars in 1247 bytes} [Mon Jul 18 16:51:16 2022] DELETE /compute/v2.1/os-volumes/630921dc-e8cc-493c-b19d-aabd05ab79a9 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:51:16.452917 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2d3e84e7-7d1f-415d-a61f-1815b608c1d0 tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] Calling method '.version_select at 0x7f4af34be820>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:16.598610 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2d3e84e7-7d1f-415d-a61f-1815b608c1d0 tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/630921dc-e8cc-493c-b19d-aabd05ab79a9" status: 200 len: 352 microversion: 2.1 time: 0.154999 Jul 18 16:51:16.599639 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 3/6] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 16:51:16 2022] GET /compute/v2.1/os-volumes/630921dc-e8cc-493c-b19d-aabd05ab79a9 => generated 352 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:17.614157 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3cee2ab7-cc68-4225-865b-cab66dfd653c tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] Calling method '.version_select at 0x7f4af3479e50>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:17.676435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-3cee2ab7-cc68-4225-865b-cab66dfd653c tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] HTTP exception thrown: Volume 630921dc-e8cc-493c-b19d-aabd05ab79a9 could not be found. Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3cee2ab7-cc68-4225-865b-cab66dfd653c tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] Request method failure captured: Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/os-volumes/630921dc-e8cc-493c-b19d-aabd05ab79a9 HTTP/1.1 Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y99q84vNsiHQEOJ0iw3Q7H_tIqoCav1s2STv9xk_1hPGHGIDDjAOoyQM7EirILu2tZeQYeHJckpTfEDSia7s9ZMuWoAZhXmuhP06eCTe47t5GH1gkqKtC7o_g4TGnNFT4lbESrqSL1nXbAJODQuXOHe0wS9jI-txiLOHsHT1g7Jlt0 Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 6dd162a361304c32be37f76f2932ddf7 Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesGetTestJSON-46962257 Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 16:51:17.681136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 16:51:17.682234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6dd162a361304c32be37f76f2932ddf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6dd162a361304c32be37f76f2932ddf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6dd162a361304c32be37f76f2932ddf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6dd162a361304c32be37f76f2932ddf7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:51:17.682234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesGetTestJSON-46962257 Jul 18 16:51:17.682234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 6dd162a361304c32be37f76f2932ddf7 Jul 18 16:51:17.682234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesGetTestJSON-46962257 Jul 18 16:51:17.682234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesGetTestJSON-46962257-project Jul 18 16:51:17.682234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 16:51:17.682234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 16:51:17.682234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 578ff2b62efc4e93ab2943954cf00b5f Jul 18 16:51:17.682234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesGetTestJSON-46962257-project Jul 18 16:51:17.682234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: Jul 18 16:51:17.682234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Volume 630921dc-e8cc-493c-b19d-aabd05ab79a9 could not be found. Jul 18 16:51:17.682234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '630921dc-e8cc-493c-b19d-aabd05ab79a9'} Jul 18 16:51:17.682234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 630921dc-e8cc-493c-b19d-aabd05ab79a9 could not be found. (HTTP 404) (Request-ID: req-8b92ec90-bf88-4a42-a7a0-3facf34f3ec0) Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:17.682884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:51:17.683882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 630921dc-e8cc-493c-b19d-aabd05ab79a9 could not be found. Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:51:17.684775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:51:17.685709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 630921dc-e8cc-493c-b19d-aabd05ab79a9 could not be found. Jul 18 16:51:17.685709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:51:17.685709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:17.685709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:51:17.685709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:17.685709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:17.685709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:17.685709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:51:17.685709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:51:17.685709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 630921dc-e8cc-493c-b19d-aabd05ab79a9 could not be found. Jul 18 16:51:17.685709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:51:17.687752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3cee2ab7-cc68-4225-865b-cab66dfd653c tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] Returning 404 to user: Volume 630921dc-e8cc-493c-b19d-aabd05ab79a9 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:51:17.688915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3cee2ab7-cc68-4225-865b-cab66dfd653c tempest-VolumesGetTestJSON-46962257 tempest-VolumesGetTestJSON-46962257-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/630921dc-e8cc-493c-b19d-aabd05ab79a9" status: 404 len: 109 microversion: 2.1 time: 0.080410 Jul 18 16:51:17.689528 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 4/7] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 16:51:17 2022] GET /compute/v2.1/os-volumes/630921dc-e8cc-493c-b19d-aabd05ab79a9 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:51:18.762396 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-632602334", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "networks": [{"uuid": "2d7d4430-421b-48ba-9ed3-e20dcce3f3c1"}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:18.989638 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] validate_networks() for [('2d7d4430-421b-48ba-9ed3-e20dcce3f3c1', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:51:21.447852 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:51:21.449034 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:51:21.449675 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:51:21.450341 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:51:21.451124 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:51:21.490650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:21.491528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:21.492349 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:21.492791 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:21.571077 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Getting quotas for project b5d7c6ee418c41cb833e47c51ea4158b. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:51:21.591532 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Getting quotas for user d6df4c3768134ebeb90d5566624a7cdd and project b5d7c6ee418c41cb833e47c51ea4158b. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:51:21.621181 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:51:21.631818 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:51:21.940042 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1ea8d656-d9c9-4c10-86e6-7d28d13983cb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.422844 Jul 18 16:51:21.949375 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 4/8] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:51:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:51:21.950904 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4324a3e0-138f-4bd0-a793-1498f5382322 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:21.952185 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4324a3e0-138f-4bd0-a793-1498f5382322 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:22.472841 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4324a3e0-138f-4bd0-a793-1498f5382322 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:22.537668 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4324a3e0-138f-4bd0-a793-1498f5382322 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1214 microversion: 2.1 time: 0.590340 Jul 18 16:51:22.544625 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 5/9] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:21 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1214 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:23.559617 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-01184319-ce82-483f-9592-d8911cde6850 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:23.561214 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-01184319-ce82-483f-9592-d8911cde6850 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:24.012937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-01184319-ce82-483f-9592-d8911cde6850 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:24.041588 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-01184319-ce82-483f-9592-d8911cde6850 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1214 microversion: 2.1 time: 0.488742 Jul 18 16:51:24.057433 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 5/10] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:23 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1214 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:25.070205 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a0a6e97c-2fb7-4077-869f-dd5b73ae7374 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:25.073112 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a0a6e97c-2fb7-4077-869f-dd5b73ae7374 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:25.257208 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a0a6e97c-2fb7-4077-869f-dd5b73ae7374 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:25.266053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a0a6e97c-2fb7-4077-869f-dd5b73ae7374 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1214 microversion: 2.1 time: 0.206441 Jul 18 16:51:25.266872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 6/11] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:25 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:26.285675 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6c5d32cc-2c08-41e5-845b-31ff2dc8a772 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:26.286428 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6c5d32cc-2c08-41e5-845b-31ff2dc8a772 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:26.292711 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6c5d32cc-2c08-41e5-845b-31ff2dc8a772 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:26.293323 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6c5d32cc-2c08-41e5-845b-31ff2dc8a772 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:26.293983 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6c5d32cc-2c08-41e5-845b-31ff2dc8a772 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:26.294422 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6c5d32cc-2c08-41e5-845b-31ff2dc8a772 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:26.775865 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-12934158-63a8-43fd-a886-02057803f581 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Action: 'create', calling method: .version_select at 0x7f4af2b7bdc0>, body: {"keypair": {"name": "tempest-keypair-1946998672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAR4n2pb1uJbetjbJoK9vtw1MInI3zgsy8r+ncRb5pTzjJn0+fzBX++xqpXdCbsXL6+msijCelE4DwMxqhJSs3fKcnWLP3hgPKgfagtXgSjHig3B2XuHtTk/kJQFNbFEA=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:26.868936 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-12934158-63a8-43fd-a886-02057803f581 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Getting quotas for project d75a7e8f1e294903ade7a227878079f8. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:51:26.880660 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-12934158-63a8-43fd-a886-02057803f581 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Getting quotas for user 9faf38f2ccec4b60a3612648073d06d3 and project d75a7e8f1e294903ade7a227878079f8. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:51:26.930704 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6c5d32cc-2c08-41e5-845b-31ff2dc8a772 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:26.979403 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6c5d32cc-2c08-41e5-845b-31ff2dc8a772 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1218 microversion: 2.1 time: 0.700571 Jul 18 16:51:26.981031 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 7/12] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:26 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1218 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:27.094013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-12934158-63a8-43fd-a886-02057803f581 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.031650 Jul 18 16:51:27.095915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 6/13] 10.222.0.76 () {62 vars in 1199 bytes} [Mon Jul 18 16:51:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1035 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 16:51:27.999413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-24be5bf9-c0c6-4ccc-8e88-3076458e4ca4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:28.001157 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-24be5bf9-c0c6-4ccc-8e88-3076458e4ca4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:28.012652 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-24be5bf9-c0c6-4ccc-8e88-3076458e4ca4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:28.019084 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-24be5bf9-c0c6-4ccc-8e88-3076458e4ca4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:28.019967 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-24be5bf9-c0c6-4ccc-8e88-3076458e4ca4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:28.020424 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-24be5bf9-c0c6-4ccc-8e88-3076458e4ca4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:28.321509 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-24be5bf9-c0c6-4ccc-8e88-3076458e4ca4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:28.323689 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-24be5bf9-c0c6-4ccc-8e88-3076458e4ca4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1266 microversion: 2.1 time: 0.329960 Jul 18 16:51:28.324277 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 8/14] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:27 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:29.342341 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e926cf10-2bac-4d43-bcf5-e84edcc8d885 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:29.343410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e926cf10-2bac-4d43-bcf5-e84edcc8d885 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:29.355002 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e926cf10-2bac-4d43-bcf5-e84edcc8d885 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:29.355463 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e926cf10-2bac-4d43-bcf5-e84edcc8d885 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:29.360397 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e926cf10-2bac-4d43-bcf5-e84edcc8d885 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:29.361110 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e926cf10-2bac-4d43-bcf5-e84edcc8d885 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:29.659223 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e926cf10-2bac-4d43-bcf5-e84edcc8d885 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:29.677541 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e926cf10-2bac-4d43-bcf5-e84edcc8d885 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1272 microversion: 2.1 time: 0.339411 Jul 18 16:51:29.679316 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 7/15] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:29 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1272 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:30.699640 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e58a5060-13df-4d2d-afd9-5ef62e2ebc9a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:30.701504 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e58a5060-13df-4d2d-afd9-5ef62e2ebc9a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:30.716859 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e58a5060-13df-4d2d-afd9-5ef62e2ebc9a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:30.717612 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e58a5060-13df-4d2d-afd9-5ef62e2ebc9a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:30.719230 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e58a5060-13df-4d2d-afd9-5ef62e2ebc9a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:30.720283 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e58a5060-13df-4d2d-afd9-5ef62e2ebc9a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:30.886356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e58a5060-13df-4d2d-afd9-5ef62e2ebc9a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:30.934466 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e58a5060-13df-4d2d-afd9-5ef62e2ebc9a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1272 microversion: 2.1 time: 0.236171 Jul 18 16:51:30.941259 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 9/16] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:30 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:31.957942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-50ce542a-eda3-4407-b006-a46cf79127b4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:31.959149 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-50ce542a-eda3-4407-b006-a46cf79127b4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:31.961593 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:31.976397 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-50ce542a-eda3-4407-b006-a46cf79127b4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:31.977134 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-50ce542a-eda3-4407-b006-a46cf79127b4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:31.979179 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-50ce542a-eda3-4407-b006-a46cf79127b4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:31.980527 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-50ce542a-eda3-4407-b006-a46cf79127b4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:32.474784 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-50ce542a-eda3-4407-b006-a46cf79127b4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:32.474784 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-50ce542a-eda3-4407-b006-a46cf79127b4 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1272 microversion: 2.1 time: 0.437063 Jul 18 16:51:32.474784 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 8/17] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:31 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1272 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:33.791631 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1562127851", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:34.105735 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] validate_networks() for [('dcc16841-fc4e-4a98-994d-a1d78c3a3330', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:51:34.452271 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3d76af38-a0dc-406e-bb6d-68c4a9f6bbed tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Action: 'create', calling method: .version_select at 0x7f4af1ade550>, body: {"keypair": {"name": "tempest-keypair-436802551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnLwqmxk+pUXGQTjcLON/I/esuUZpozW0duzmX4R1gEagebypo/v3dNnGRdDHGYqi8w1v/54UGXvbYGqpu4d+cIgIEWUvMvQGxy6T1qMd/yK9nZ9I7GXVh5VziHpEprqg=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:34.509727 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-3d76af38-a0dc-406e-bb6d-68c4a9f6bbed tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for project 4f82344d2255427582cc29e253b37f0b. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:51:34.520084 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-3d76af38-a0dc-406e-bb6d-68c4a9f6bbed tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for user 0cf277a2d03443c8af7a7bee2731d9d1 and project 4f82344d2255427582cc29e253b37f0b. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:51:34.747480 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3d76af38-a0dc-406e-bb6d-68c4a9f6bbed tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.881192 Jul 18 16:51:34.748812 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 9/18] 10.222.0.76 () {60 vars in 1158 bytes} [Mon Jul 18 16:51:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:34.754350 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-19ef1af8-5542-47df-b64a-3f7c957540ac tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:34.755269 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-19ef1af8-5542-47df-b64a-3f7c957540ac tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:34.775685 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-19ef1af8-5542-47df-b64a-3f7c957540ac tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:34.776316 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-19ef1af8-5542-47df-b64a-3f7c957540ac tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:34.777313 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-19ef1af8-5542-47df-b64a-3f7c957540ac tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:34.780330 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-19ef1af8-5542-47df-b64a-3f7c957540ac tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:35.263302 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=4 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:35.606157 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-19ef1af8-5542-47df-b64a-3f7c957540ac tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:35.626666 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-19ef1af8-5542-47df-b64a-3f7c957540ac tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.873682 Jul 18 16:51:35.628659 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 10/19] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:34 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:36.647224 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-95ec014f-7f39-4238-90b6-01ba72f9ab4d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:36.647876 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-95ec014f-7f39-4238-90b6-01ba72f9ab4d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:36.664953 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-95ec014f-7f39-4238-90b6-01ba72f9ab4d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:36.665733 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-95ec014f-7f39-4238-90b6-01ba72f9ab4d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:36.667100 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-95ec014f-7f39-4238-90b6-01ba72f9ab4d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:36.675060 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-95ec014f-7f39-4238-90b6-01ba72f9ab4d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:36.973053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:51:36.973881 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:51:36.978683 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:51:36.978683 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:51:36.978683 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:51:37.037914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:37.037914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:37.037914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:37.037914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:37.201803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Getting quotas for project 2e5e262f0ed548ee8a4450d0d4806667. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:51:37.249215 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Getting quotas for user 4d27db5cdd9e453dbd93b862db694309 and project 2e5e262f0ed548ee8a4450d0d4806667. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:51:37.342508 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:51:37.348687 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:51:37.418845 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-95ec014f-7f39-4238-90b6-01ba72f9ab4d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:37.433253 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-95ec014f-7f39-4238-90b6-01ba72f9ab4d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.790581 Jul 18 16:51:37.441606 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 11/20] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:36 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:37.472741 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1249468659", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6631fbb-d13e-4de4-82dc-3ba51817ec4e"}], "security_groups": [{"name": "tempest-securitygroup--163447296"}], "key_name": "tempest-keypair-1946998672", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:37.669744 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-caa5f6e7-44f5-45c0-a241-98662195209a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.189901 Jul 18 16:51:37.672325 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 10/21] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:51:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 5193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:51:37.704638 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d3f7d5af-89d6-4e9e-bdb6-f6d31c8fe132 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:37.707234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d3f7d5af-89d6-4e9e-bdb6-f6d31c8fe132 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:37.884377 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d3f7d5af-89d6-4e9e-bdb6-f6d31c8fe132 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:37.909836 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] validate_networks() for [('c6631fbb-d13e-4de4-82dc-3ba51817ec4e', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:51:37.926192 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d3f7d5af-89d6-4e9e-bdb6-f6d31c8fe132 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1222 microversion: 2.1 time: 0.241668 Jul 18 16:51:37.926192 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 11/22] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:37 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1222 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:38.459876 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-319d537f-2deb-4b23-b9d0-43f594696aae tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:38.461389 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-319d537f-2deb-4b23-b9d0-43f594696aae tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:38.474638 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-319d537f-2deb-4b23-b9d0-43f594696aae tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:38.475458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-319d537f-2deb-4b23-b9d0-43f594696aae tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:38.476459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-319d537f-2deb-4b23-b9d0-43f594696aae tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:38.492946 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-319d537f-2deb-4b23-b9d0-43f594696aae tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:39.221441 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-319d537f-2deb-4b23-b9d0-43f594696aae tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:39.244782 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-319d537f-2deb-4b23-b9d0-43f594696aae tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.793358 Jul 18 16:51:39.245556 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 12/23] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:38 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:39.259949 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1840955139", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:39.418315 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] validate_networks() for [('dcc16841-fc4e-4a98-994d-a1d78c3a3330', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:51:39.706036 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:51:39.706036 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:51:39.706036 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:51:39.706036 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:51:39.706036 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:51:39.731012 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:39.732853 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:39.736151 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:39.738040 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:39.834431 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Getting quotas for project d75a7e8f1e294903ade7a227878079f8. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:51:39.849128 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Getting quotas for user 9faf38f2ccec4b60a3612648073d06d3 and project d75a7e8f1e294903ade7a227878079f8. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:51:39.895958 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:51:39.902048 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:51:40.272987 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cdc20838-08e5-4af7-bf89-195bce269c0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.828480 Jul 18 16:51:40.285199 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 12/24] 10.222.0.76 () {62 vars in 1187 bytes} [Mon Jul 18 16:51:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 2841 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 16:51:40.299880 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dde20828-a6ba-491c-b1cf-0d5b510f612c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:40.301973 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dde20828-a6ba-491c-b1cf-0d5b510f612c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:40.379195 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dde20828-a6ba-491c-b1cf-0d5b510f612c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:40.380111 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dde20828-a6ba-491c-b1cf-0d5b510f612c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:40.385743 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dde20828-a6ba-491c-b1cf-0d5b510f612c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:40.387023 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dde20828-a6ba-491c-b1cf-0d5b510f612c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:41.055894 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dde20828-a6ba-491c-b1cf-0d5b510f612c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:41.074350 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dde20828-a6ba-491c-b1cf-0d5b510f612c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.784922 Jul 18 16:51:41.099432 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 13/25] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:40 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:41.113362 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-df4bfd16-6ff4-4799-89d2-a96787ead44f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:41.144482 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-df4bfd16-6ff4-4799-89d2-a96787ead44f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:41.310088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-df4bfd16-6ff4-4799-89d2-a96787ead44f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:41.329656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-df4bfd16-6ff4-4799-89d2-a96787ead44f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:41.331471 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-df4bfd16-6ff4-4799-89d2-a96787ead44f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:41.340689 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-df4bfd16-6ff4-4799-89d2-a96787ead44f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1282 microversion: 2.20 time: 0.247559 Jul 18 16:51:41.357294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 14/26] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:41 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1282 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:51:41.841708 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-22dc1982-2153-4dce-90d9-f66a633bab7c req-3d326007-0e95-4e84-b287-2bb333fc2a90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dd8e166-14c8-46d5-80a3-a70d57745265", "tag": "11b787d6-ea05-4fdd-affb-4ab3787f16ab"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:41.897462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-22dc1982-2153-4dce-90d9-f66a633bab7c req-3d326007-0e95-4e84-b287-2bb333fc2a90 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:41.897964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-22dc1982-2153-4dce-90d9-f66a633bab7c req-3d326007-0e95-4e84-b287-2bb333fc2a90 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:41.949808 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:51:41.950225 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:51:41.950709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:51:41.951123 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:51:41.952086 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:51:41.974496 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:41.976469 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:41.980022 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:41.986682 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.012000 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-22dc1982-2153-4dce-90d9-f66a633bab7c req-3d326007-0e95-4e84-b287-2bb333fc2a90 service nova] Creating event network-changed:11b787d6-ea05-4fdd-affb-4ab3787f16ab for instance 4dd8e166-14c8-46d5-80a3-a70d57745265 on hv-cinder-83754 Jul 18 16:51:42.016835 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-22dc1982-2153-4dce-90d9-f66a633bab7c req-3d326007-0e95-4e84-b287-2bb333fc2a90 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124867) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 16:51:42.019582 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-15a370a9-b13d-430d-bc1b-aa00a1835d7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.022274 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-15a370a9-b13d-430d-bc1b-aa00a1835d7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.023415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-15a370a9-b13d-430d-bc1b-aa00a1835d7c None None] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.042589 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-15a370a9-b13d-430d-bc1b-aa00a1835d7c None None] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.057852 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Getting quotas for project 2e5e262f0ed548ee8a4450d0d4806667. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:51:42.060784 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.compute.rpcapi [None req-15a370a9-b13d-430d-bc1b-aa00a1835d7c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 16:51:42.062278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-15a370a9-b13d-430d-bc1b-aa00a1835d7c None None] Releasing lock "compute-rpcapi-router" {{(pid=124867) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 16:51:42.073562 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Getting quotas for user 4d27db5cdd9e453dbd93b862db694309 and project 2e5e262f0ed548ee8a4450d0d4806667. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:51:42.088004 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:51:42.091683 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:51:42.116215 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-15a370a9-b13d-430d-bc1b-aa00a1835d7c None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.755984 Jul 18 16:51:42.125557 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 15/27] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:42.137687 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-61a0f097-0789-4ae5-abbc-fecd9c953b4b tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:42.141347 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-61a0f097-0789-4ae5-abbc-fecd9c953b4b tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:42.179953 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-61a0f097-0789-4ae5-abbc-fecd9c953b4b tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.180671 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-61a0f097-0789-4ae5-abbc-fecd9c953b4b tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.184982 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-61a0f097-0789-4ae5-abbc-fecd9c953b4b tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.186453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-61a0f097-0789-4ae5-abbc-fecd9c953b4b tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.334866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-645c2fce-88cc-474f-af27-b73166275b53 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.080420 Jul 18 16:51:42.336364 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 13/28] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:51:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 3090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:51:42.347180 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5b55fd8c-9f38-4ff3-a7a8-c06d1cfde91e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:42.348183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5b55fd8c-9f38-4ff3-a7a8-c06d1cfde91e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:42.565679 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5b55fd8c-9f38-4ff3-a7a8-c06d1cfde91e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:42.581529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5b55fd8c-9f38-4ff3-a7a8-c06d1cfde91e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1222 microversion: 2.1 time: 0.233573 Jul 18 16:51:42.582394 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 14/29] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:42 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1222 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:42.619540 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-48709f8f-a2d4-4637-bb6f-0691c5d1d0bf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:42.620440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-48709f8f-a2d4-4637-bb6f-0691c5d1d0bf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:42.643464 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-61a0f097-0789-4ae5-abbc-fecd9c953b4b tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:42.663540 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-61a0f097-0789-4ae5-abbc-fecd9c953b4b tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.535038 Jul 18 16:51:42.672743 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 16/30] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:42 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:42.672889 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48709f8f-a2d4-4637-bb6f-0691c5d1d0bf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.672889 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48709f8f-a2d4-4637-bb6f-0691c5d1d0bf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.672889 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48709f8f-a2d4-4637-bb6f-0691c5d1d0bf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.672889 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48709f8f-a2d4-4637-bb6f-0691c5d1d0bf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.907681 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-48709f8f-a2d4-4637-bb6f-0691c5d1d0bf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:42.934823 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-48709f8f-a2d4-4637-bb6f-0691c5d1d0bf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:42.936469 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-48709f8f-a2d4-4637-bb6f-0691c5d1d0bf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:42.949614 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-48709f8f-a2d4-4637-bb6f-0691c5d1d0bf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1286 microversion: 2.20 time: 0.359761 Jul 18 16:51:42.960708 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 15/31] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:42 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1286 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:51:43.601306 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-40e68b3d-8944-4c14-863c-0a3e7d0209d1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:43.602041 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-40e68b3d-8944-4c14-863c-0a3e7d0209d1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:43.687513 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5b96182c-d7b1-4dc1-885a-3917dc8626e1 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:43.688425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5b96182c-d7b1-4dc1-885a-3917dc8626e1 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:43.704451 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5b96182c-d7b1-4dc1-885a-3917dc8626e1 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:43.705834 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5b96182c-d7b1-4dc1-885a-3917dc8626e1 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:43.708172 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5b96182c-d7b1-4dc1-885a-3917dc8626e1 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:43.708788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5b96182c-d7b1-4dc1-885a-3917dc8626e1 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:43.906095 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-40e68b3d-8944-4c14-863c-0a3e7d0209d1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:43.914044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-40e68b3d-8944-4c14-863c-0a3e7d0209d1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1222 microversion: 2.1 time: 0.316752 Jul 18 16:51:43.927633 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 17/32] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:43 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1222 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:43.970442 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-00d9df6f-d916-4341-8d47-6503e140ab05 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:43.971312 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-00d9df6f-d916-4341-8d47-6503e140ab05 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:43.982622 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00d9df6f-d916-4341-8d47-6503e140ab05 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:43.984244 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00d9df6f-d916-4341-8d47-6503e140ab05 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:43.987693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00d9df6f-d916-4341-8d47-6503e140ab05 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:43.990683 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00d9df6f-d916-4341-8d47-6503e140ab05 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:44.163630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-00d9df6f-d916-4341-8d47-6503e140ab05 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:44.193617 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-00d9df6f-d916-4341-8d47-6503e140ab05 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:44.197633 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-00d9df6f-d916-4341-8d47-6503e140ab05 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:44.202603 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-00d9df6f-d916-4341-8d47-6503e140ab05 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1334 microversion: 2.20 time: 0.235612 Jul 18 16:51:44.205055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 18/33] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:43 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1334 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:51:44.401284 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5b96182c-d7b1-4dc1-885a-3917dc8626e1 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:44.410796 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5b96182c-d7b1-4dc1-885a-3917dc8626e1 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.728536 Jul 18 16:51:44.423797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 16/34] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:43 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:44.752977 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-705855717", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae3a9cc1-1c89-413a-9dc0-c337425ad213"}], "security_groups": [{"name": "tempest-securitygroup--1639181090"}], "key_name": "tempest-keypair-436802551", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:44.795211 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:44.940932 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2350ea13-a8c8-4edb-9843-f0c4bf297ac7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:44.946221 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2350ea13-a8c8-4edb-9843-f0c4bf297ac7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:44.972796 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2350ea13-a8c8-4edb-9843-f0c4bf297ac7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:44.973321 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2350ea13-a8c8-4edb-9843-f0c4bf297ac7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:44.976175 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2350ea13-a8c8-4edb-9843-f0c4bf297ac7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:44.979898 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2350ea13-a8c8-4edb-9843-f0c4bf297ac7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:45.079294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] validate_networks() for [('ae3a9cc1-1c89-413a-9dc0-c337425ad213', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:51:45.132723 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2350ea13-a8c8-4edb-9843-f0c4bf297ac7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:45.151000 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2350ea13-a8c8-4edb-9843-f0c4bf297ac7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1226 microversion: 2.1 time: 0.219001 Jul 18 16:51:45.154740 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 17/35] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:44 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1226 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:45.226204 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-29bb5947-0e2b-4f9b-81fc-34f570165d51 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:45.226983 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-29bb5947-0e2b-4f9b-81fc-34f570165d51 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:45.254570 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29bb5947-0e2b-4f9b-81fc-34f570165d51 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:45.258165 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29bb5947-0e2b-4f9b-81fc-34f570165d51 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:45.269737 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29bb5947-0e2b-4f9b-81fc-34f570165d51 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:45.271303 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29bb5947-0e2b-4f9b-81fc-34f570165d51 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:45.982619 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-29bb5947-0e2b-4f9b-81fc-34f570165d51 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:45.995439 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-29bb5947-0e2b-4f9b-81fc-34f570165d51 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:45.997654 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-29bb5947-0e2b-4f9b-81fc-34f570165d51 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:46.000952 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-29bb5947-0e2b-4f9b-81fc-34f570165d51 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1342 microversion: 2.20 time: 0.780716 Jul 18 16:51:46.002249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 18/36] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:45 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1342 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:51:46.007651 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-09cc9b40-2c03-4f15-80ff-e84eae25e90c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:46.008487 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-09cc9b40-2c03-4f15-80ff-e84eae25e90c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:46.018228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09cc9b40-2c03-4f15-80ff-e84eae25e90c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.018972 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09cc9b40-2c03-4f15-80ff-e84eae25e90c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.020002 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09cc9b40-2c03-4f15-80ff-e84eae25e90c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.020594 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09cc9b40-2c03-4f15-80ff-e84eae25e90c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.310588 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:51:46.311787 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:51:46.313162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:51:46.313970 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:51:46.314536 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:51:46.346041 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=27 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:46.353344 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.365696 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.367457 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.370169 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.397626 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=51 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:46.446184 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for project 4f82344d2255427582cc29e253b37f0b. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:51:46.456614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for user 0cf277a2d03443c8af7a7bee2731d9d1 and project 4f82344d2255427582cc29e253b37f0b. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:51:46.483872 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:51:46.486750 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:51:46.636464 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-09cc9b40-2c03-4f15-80ff-e84eae25e90c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:46.646948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-09cc9b40-2c03-4f15-80ff-e84eae25e90c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.643090 Jul 18 16:51:46.658831 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 19/37] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:46 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:46.663844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b92f73ef-0077-4184-ad51-f718f444138f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:46.664675 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b92f73ef-0077-4184-ad51-f718f444138f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:46.670999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b92f73ef-0077-4184-ad51-f718f444138f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.672934 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b92f73ef-0077-4184-ad51-f718f444138f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.673916 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b92f73ef-0077-4184-ad51-f718f444138f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.674580 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b92f73ef-0077-4184-ad51-f718f444138f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.794757 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b92f73ef-0077-4184-ad51-f718f444138f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:46.806736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b92f73ef-0077-4184-ad51-f718f444138f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1274 microversion: 2.1 time: 0.146560 Jul 18 16:51:46.807684 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 20/38] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:46 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1274 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:46.969918 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aa32701c-37c4-4495-9f02-08e45c1c312f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.198451 Jul 18 16:51:46.971007 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 19/39] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:51:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 2224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:51:46.991559 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2f4628fc-1ef7-46ea-bc9d-ebc5d1614dc4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:46.992740 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2f4628fc-1ef7-46ea-bc9d-ebc5d1614dc4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:47.027775 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-889e1d88-6bb9-45f3-ac63-05aadc698101 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:47.030238 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-889e1d88-6bb9-45f3-ac63-05aadc698101 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:47.041377 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-889e1d88-6bb9-45f3-ac63-05aadc698101 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:47.041847 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-889e1d88-6bb9-45f3-ac63-05aadc698101 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:47.043132 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-889e1d88-6bb9-45f3-ac63-05aadc698101 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:47.043616 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-889e1d88-6bb9-45f3-ac63-05aadc698101 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:47.155887 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-889e1d88-6bb9-45f3-ac63-05aadc698101 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:47.172990 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-889e1d88-6bb9-45f3-ac63-05aadc698101 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:47.174777 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-889e1d88-6bb9-45f3-ac63-05aadc698101 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:47.177696 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-889e1d88-6bb9-45f3-ac63-05aadc698101 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1340 microversion: 2.20 time: 0.154886 Jul 18 16:51:47.186349 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 20/40] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:47 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1340 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:51:47.241552 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2f4628fc-1ef7-46ea-bc9d-ebc5d1614dc4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:47.271883 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2f4628fc-1ef7-46ea-bc9d-ebc5d1614dc4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1240 microversion: 2.1 time: 0.265537 Jul 18 16:51:47.271883 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 21/41] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:46 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1240 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:47.665946 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dd49adff-a856-4500-b77b-62591da64688 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:47.667214 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dd49adff-a856-4500-b77b-62591da64688 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:47.673616 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dd49adff-a856-4500-b77b-62591da64688 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:47.674067 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dd49adff-a856-4500-b77b-62591da64688 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:47.674853 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dd49adff-a856-4500-b77b-62591da64688 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:47.675292 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dd49adff-a856-4500-b77b-62591da64688 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:47.810337 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dd49adff-a856-4500-b77b-62591da64688 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:47.818538 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dd49adff-a856-4500-b77b-62591da64688 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.156560 Jul 18 16:51:47.819154 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 21/42] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:47 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:47.824735 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-898d06ef-c91f-4ca7-81be-7dfef16c12f5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:47.826803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-898d06ef-c91f-4ca7-81be-7dfef16c12f5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:47.832318 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-898d06ef-c91f-4ca7-81be-7dfef16c12f5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:47.832771 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-898d06ef-c91f-4ca7-81be-7dfef16c12f5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:47.833622 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-898d06ef-c91f-4ca7-81be-7dfef16c12f5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:47.834102 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-898d06ef-c91f-4ca7-81be-7dfef16c12f5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:47.900779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-898d06ef-c91f-4ca7-81be-7dfef16c12f5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:47.908770 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-898d06ef-c91f-4ca7-81be-7dfef16c12f5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1274 microversion: 2.1 time: 0.088119 Jul 18 16:51:47.909391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 22/43] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:47 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:48.200143 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3fff6fc2-0a3a-4c9f-8af0-49cbb39583fc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:48.201104 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3fff6fc2-0a3a-4c9f-8af0-49cbb39583fc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:48.208696 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3fff6fc2-0a3a-4c9f-8af0-49cbb39583fc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.209206 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3fff6fc2-0a3a-4c9f-8af0-49cbb39583fc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:48.210135 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3fff6fc2-0a3a-4c9f-8af0-49cbb39583fc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.210608 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3fff6fc2-0a3a-4c9f-8af0-49cbb39583fc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:48.291038 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d3c53051-d2b7-48b8-b655-afcab665e975 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:48.297176 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d3c53051-d2b7-48b8-b655-afcab665e975 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:48.331416 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3fff6fc2-0a3a-4c9f-8af0-49cbb39583fc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:48.348457 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3fff6fc2-0a3a-4c9f-8af0-49cbb39583fc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:48.350305 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3fff6fc2-0a3a-4c9f-8af0-49cbb39583fc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:48.351982 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3fff6fc2-0a3a-4c9f-8af0-49cbb39583fc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1340 microversion: 2.20 time: 0.156766 Jul 18 16:51:48.364286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 22/44] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:48 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1340 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:51:48.402513 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d3c53051-d2b7-48b8-b655-afcab665e975 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:48.413790 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d3c53051-d2b7-48b8-b655-afcab665e975 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1240 microversion: 2.1 time: 0.129538 Jul 18 16:51:48.417982 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 23/45] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:48 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1240 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:48.837418 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1d33cbe8-57f8-48df-a7c4-45fb2da338a7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:48.838194 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1d33cbe8-57f8-48df-a7c4-45fb2da338a7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:48.847083 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d33cbe8-57f8-48df-a7c4-45fb2da338a7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.847646 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d33cbe8-57f8-48df-a7c4-45fb2da338a7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:48.848745 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d33cbe8-57f8-48df-a7c4-45fb2da338a7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.849630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d33cbe8-57f8-48df-a7c4-45fb2da338a7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:48.926307 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-48ef9186-226b-4dd4-9425-b78c260eb2f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:48.927229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-48ef9186-226b-4dd4-9425-b78c260eb2f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:48.943523 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48ef9186-226b-4dd4-9425-b78c260eb2f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.945092 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48ef9186-226b-4dd4-9425-b78c260eb2f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:48.946327 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48ef9186-226b-4dd4-9425-b78c260eb2f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.947829 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48ef9186-226b-4dd4-9425-b78c260eb2f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:49.042316 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-48ef9186-226b-4dd4-9425-b78c260eb2f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:49.053191 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1d33cbe8-57f8-48df-a7c4-45fb2da338a7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:49.071521 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-48ef9186-226b-4dd4-9425-b78c260eb2f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1282 microversion: 2.1 time: 0.136959 Jul 18 16:51:49.071521 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 24/46] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:48 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:49.071813 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1d33cbe8-57f8-48df-a7c4-45fb2da338a7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.229248 Jul 18 16:51:49.071813 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 23/47] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:48 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:49.372511 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-635a43a0-a0d6-4497-9bb0-13e4d48d79b3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:49.373270 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-635a43a0-a0d6-4497-9bb0-13e4d48d79b3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:49.379988 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-635a43a0-a0d6-4497-9bb0-13e4d48d79b3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:49.380458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-635a43a0-a0d6-4497-9bb0-13e4d48d79b3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:49.381368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-635a43a0-a0d6-4497-9bb0-13e4d48d79b3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:49.381897 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-635a43a0-a0d6-4497-9bb0-13e4d48d79b3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:49.433361 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5090a355-8ba5-495c-8f74-b672eb3c90df tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:49.433969 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5090a355-8ba5-495c-8f74-b672eb3c90df tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:49.440338 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5090a355-8ba5-495c-8f74-b672eb3c90df tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:49.440824 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5090a355-8ba5-495c-8f74-b672eb3c90df tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:49.441628 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5090a355-8ba5-495c-8f74-b672eb3c90df tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:49.442060 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5090a355-8ba5-495c-8f74-b672eb3c90df tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:49.506192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5090a355-8ba5-495c-8f74-b672eb3c90df tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:49.513750 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5090a355-8ba5-495c-8f74-b672eb3c90df tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1244 microversion: 2.1 time: 0.084358 Jul 18 16:51:49.514324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 24/48] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:49 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:49.524906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-635a43a0-a0d6-4497-9bb0-13e4d48d79b3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:49.534247 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-635a43a0-a0d6-4497-9bb0-13e4d48d79b3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:49.535923 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-635a43a0-a0d6-4497-9bb0-13e4d48d79b3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:49.537076 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-635a43a0-a0d6-4497-9bb0-13e4d48d79b3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.169492 Jul 18 16:51:49.549686 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 25/49] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:49 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:51:50.079939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9eab1b9d-78c4-45f7-bf81-1a27a1039b91 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:50.080679 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9eab1b9d-78c4-45f7-bf81-1a27a1039b91 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:50.084380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c2bb0aee-db4c-40b0-b71f-cd842ff7e4c7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:50.085054 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c2bb0aee-db4c-40b0-b71f-cd842ff7e4c7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:50.093799 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9eab1b9d-78c4-45f7-bf81-1a27a1039b91 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:50.094422 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9eab1b9d-78c4-45f7-bf81-1a27a1039b91 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:50.095405 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9eab1b9d-78c4-45f7-bf81-1a27a1039b91 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:50.095708 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c2bb0aee-db4c-40b0-b71f-cd842ff7e4c7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:50.096179 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c2bb0aee-db4c-40b0-b71f-cd842ff7e4c7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:50.096969 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c2bb0aee-db4c-40b0-b71f-cd842ff7e4c7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:50.097153 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9eab1b9d-78c4-45f7-bf81-1a27a1039b91 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:50.097436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c2bb0aee-db4c-40b0-b71f-cd842ff7e4c7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:50.290020 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c2bb0aee-db4c-40b0-b71f-cd842ff7e4c7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:50.298518 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c2bb0aee-db4c-40b0-b71f-cd842ff7e4c7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1280 microversion: 2.1 time: 0.218631 Jul 18 16:51:50.305577 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 26/50] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:50 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1280 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:50.504326 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9eab1b9d-78c4-45f7-bf81-1a27a1039b91 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:50.514563 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9eab1b9d-78c4-45f7-bf81-1a27a1039b91 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.439411 Jul 18 16:51:50.521956 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 25/51] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:50 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:50.535696 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8f86a110-19d0-4703-a1da-b5bbf9747d17 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:50.536332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8f86a110-19d0-4703-a1da-b5bbf9747d17 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:50.547275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8f86a110-19d0-4703-a1da-b5bbf9747d17 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:50.547925 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8f86a110-19d0-4703-a1da-b5bbf9747d17 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:50.550106 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8f86a110-19d0-4703-a1da-b5bbf9747d17 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:50.550738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8f86a110-19d0-4703-a1da-b5bbf9747d17 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:50.567347 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bab9c763-0a02-46aa-b9d4-804ab967b9d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:50.567970 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bab9c763-0a02-46aa-b9d4-804ab967b9d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:50.587419 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab9c763-0a02-46aa-b9d4-804ab967b9d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:50.587878 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab9c763-0a02-46aa-b9d4-804ab967b9d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:50.588674 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab9c763-0a02-46aa-b9d4-804ab967b9d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:50.589142 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab9c763-0a02-46aa-b9d4-804ab967b9d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:50.683180 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8f86a110-19d0-4703-a1da-b5bbf9747d17 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:50.706946 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8f86a110-19d0-4703-a1da-b5bbf9747d17 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1236 microversion: 2.1 time: 0.166975 Jul 18 16:51:50.706946 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 27/52] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:50 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1236 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:50.789666 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-bab9c763-0a02-46aa-b9d4-804ab967b9d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:50.800883 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-bab9c763-0a02-46aa-b9d4-804ab967b9d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:50.803542 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-bab9c763-0a02-46aa-b9d4-804ab967b9d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:50.807047 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bab9c763-0a02-46aa-b9d4-804ab967b9d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.243638 Jul 18 16:51:50.808826 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 26/53] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:50 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:51:51.317284 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7527f811-b863-4100-ab77-076ef641a0ae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:51.320439 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7527f811-b863-4100-ab77-076ef641a0ae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:51.324186 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7527f811-b863-4100-ab77-076ef641a0ae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:51.325050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7527f811-b863-4100-ab77-076ef641a0ae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:51.325992 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7527f811-b863-4100-ab77-076ef641a0ae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:51.326533 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7527f811-b863-4100-ab77-076ef641a0ae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:51.546209 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5819d5b9-4de6-41a1-8149-96ae42f4372c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:51.548778 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5819d5b9-4de6-41a1-8149-96ae42f4372c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:51.569410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5819d5b9-4de6-41a1-8149-96ae42f4372c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:51.570008 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5819d5b9-4de6-41a1-8149-96ae42f4372c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:51.570980 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5819d5b9-4de6-41a1-8149-96ae42f4372c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:51.571651 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5819d5b9-4de6-41a1-8149-96ae42f4372c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:51.722511 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7527f811-b863-4100-ab77-076ef641a0ae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:51.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5819d5b9-4de6-41a1-8149-96ae42f4372c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:51.729659 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:51.738918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7527f811-b863-4100-ab77-076ef641a0ae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.421515 Jul 18 16:51:51.738918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 28/54] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:51 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:51.745926 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5819d5b9-4de6-41a1-8149-96ae42f4372c tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.210569 Jul 18 16:51:51.751701 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-05ed8b03-2288-46bb-af31-7a9cba03a745 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:51.752320 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-05ed8b03-2288-46bb-af31-7a9cba03a745 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:51.761097 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 27/55] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:51 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:51.773222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05ed8b03-2288-46bb-af31-7a9cba03a745 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:51.773222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05ed8b03-2288-46bb-af31-7a9cba03a745 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:51.773222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05ed8b03-2288-46bb-af31-7a9cba03a745 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:51.773222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05ed8b03-2288-46bb-af31-7a9cba03a745 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:51.826970 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-659fd07b-3fd0-4d41-89b3-7bb549d3ae90 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:51.828499 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-659fd07b-3fd0-4d41-89b3-7bb549d3ae90 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:51.844355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-659fd07b-3fd0-4d41-89b3-7bb549d3ae90 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:51.845568 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-659fd07b-3fd0-4d41-89b3-7bb549d3ae90 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:51.846628 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-659fd07b-3fd0-4d41-89b3-7bb549d3ae90 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:51.847349 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-659fd07b-3fd0-4d41-89b3-7bb549d3ae90 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:51.972061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-05ed8b03-2288-46bb-af31-7a9cba03a745 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:51.990858 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-05ed8b03-2288-46bb-af31-7a9cba03a745 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1236 microversion: 2.1 time: 0.245665 Jul 18 16:51:51.990858 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 29/56] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:51 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1236 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:52.014308 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=4 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:52.054931 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-aad09119-e3e1-4a86-88e8-2bd563649127 req-e7acab73-ad39-476e-a281-5ef284d27a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d31815-4f8c-4e76-adcb-8039b88488d0", "tag": "cbb20d80-19a9-48b1-be96-866c4a0904d4"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:52.059025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:52.070330 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-659fd07b-3fd0-4d41-89b3-7bb549d3ae90 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:52.072772 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-aad09119-e3e1-4a86-88e8-2bd563649127 req-e7acab73-ad39-476e-a281-5ef284d27a52 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.073320 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-aad09119-e3e1-4a86-88e8-2bd563649127 req-e7acab73-ad39-476e-a281-5ef284d27a52 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.095231 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-659fd07b-3fd0-4d41-89b3-7bb549d3ae90 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:52.097900 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-659fd07b-3fd0-4d41-89b3-7bb549d3ae90 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:52.105326 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-659fd07b-3fd0-4d41-89b3-7bb549d3ae90 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.276442 Jul 18 16:51:52.105326 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 28/57] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:51 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:51:52.120228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-aad09119-e3e1-4a86-88e8-2bd563649127 req-e7acab73-ad39-476e-a281-5ef284d27a52 service nova] Creating event network-changed:cbb20d80-19a9-48b1-be96-866c4a0904d4 for instance c3d31815-4f8c-4e76-adcb-8039b88488d0 on hv-cinder-83754 Jul 18 16:51:52.121236 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-aad09119-e3e1-4a86-88e8-2bd563649127 req-e7acab73-ad39-476e-a281-5ef284d27a52 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 16:51:52.128206 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-18a55f70-b75e-4675-9a61-5a6e22600557 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.137798 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-18a55f70-b75e-4675-9a61-5a6e22600557 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.137798 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-18a55f70-b75e-4675-9a61-5a6e22600557 None None] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.137798 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-18a55f70-b75e-4675-9a61-5a6e22600557 None None] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.155028 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.compute.rpcapi [None req-18a55f70-b75e-4675-9a61-5a6e22600557 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 16:51:52.157752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-18a55f70-b75e-4675-9a61-5a6e22600557 None None] Releasing lock "compute-rpcapi-router" {{(pid=124868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 16:51:52.186661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-18a55f70-b75e-4675-9a61-5a6e22600557 None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200175 Jul 18 16:51:52.188066 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 30/58] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:52.756582 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6dd86036-8d11-42b0-a02d-ee0d7e7f69fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:52.757267 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6dd86036-8d11-42b0-a02d-ee0d7e7f69fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:52.770897 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c12951a4-44a6-4076-9f86-9d74aa1b1284 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:52.772832 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c12951a4-44a6-4076-9f86-9d74aa1b1284 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:52.779444 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c12951a4-44a6-4076-9f86-9d74aa1b1284 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.779982 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c12951a4-44a6-4076-9f86-9d74aa1b1284 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.780803 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6dd86036-8d11-42b0-a02d-ee0d7e7f69fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.781562 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c12951a4-44a6-4076-9f86-9d74aa1b1284 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.781893 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c12951a4-44a6-4076-9f86-9d74aa1b1284 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.782098 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6dd86036-8d11-42b0-a02d-ee0d7e7f69fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.783545 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6dd86036-8d11-42b0-a02d-ee0d7e7f69fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.784164 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6dd86036-8d11-42b0-a02d-ee0d7e7f69fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:53.006778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c12951a4-44a6-4076-9f86-9d74aa1b1284 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:53.017118 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c12951a4-44a6-4076-9f86-9d74aa1b1284 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.253172 Jul 18 16:51:53.022919 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 31/59] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:52 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:53.024036 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f939cb6a-a645-4ad6-b052-b27241058194 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:53.024698 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f939cb6a-a645-4ad6-b052-b27241058194 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:53.032228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f939cb6a-a645-4ad6-b052-b27241058194 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:53.032836 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f939cb6a-a645-4ad6-b052-b27241058194 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:53.033670 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f939cb6a-a645-4ad6-b052-b27241058194 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:53.034112 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f939cb6a-a645-4ad6-b052-b27241058194 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:53.051029 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6dd86036-8d11-42b0-a02d-ee0d7e7f69fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:53.063993 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6dd86036-8d11-42b0-a02d-ee0d7e7f69fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.311281 Jul 18 16:51:53.065343 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 29/60] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:52 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:53.118650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e652797e-65ef-4d7a-b1eb-00d1b1a1a7de tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:53.119272 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e652797e-65ef-4d7a-b1eb-00d1b1a1a7de tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:53.125181 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f939cb6a-a645-4ad6-b052-b27241058194 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:53.130870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e652797e-65ef-4d7a-b1eb-00d1b1a1a7de tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:53.131522 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e652797e-65ef-4d7a-b1eb-00d1b1a1a7de tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:53.132486 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e652797e-65ef-4d7a-b1eb-00d1b1a1a7de tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:53.133042 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e652797e-65ef-4d7a-b1eb-00d1b1a1a7de tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:53.133943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f939cb6a-a645-4ad6-b052-b27241058194 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1236 microversion: 2.1 time: 0.114823 Jul 18 16:51:53.134680 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 32/61] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:53 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1236 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:53.338286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e652797e-65ef-4d7a-b1eb-00d1b1a1a7de tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:53.346979 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e652797e-65ef-4d7a-b1eb-00d1b1a1a7de tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:53.348482 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e652797e-65ef-4d7a-b1eb-00d1b1a1a7de tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:53.349621 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e652797e-65ef-4d7a-b1eb-00d1b1a1a7de tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.234936 Jul 18 16:51:53.350236 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 30/62] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:53 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:51:54.045532 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-36a0a77e-514b-42f2-b9f1-50b8e4ea7cd9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:54.047517 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-36a0a77e-514b-42f2-b9f1-50b8e4ea7cd9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:54.075631 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36a0a77e-514b-42f2-b9f1-50b8e4ea7cd9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.080340 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36a0a77e-514b-42f2-b9f1-50b8e4ea7cd9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.083034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36a0a77e-514b-42f2-b9f1-50b8e4ea7cd9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.083514 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-af36fbb6-816a-4c85-af7e-f3ad85b888b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:54.084012 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36a0a77e-514b-42f2-b9f1-50b8e4ea7cd9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.084323 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-af36fbb6-816a-4c85-af7e-f3ad85b888b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:54.092380 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-af36fbb6-816a-4c85-af7e-f3ad85b888b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.104214 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-af36fbb6-816a-4c85-af7e-f3ad85b888b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.106300 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-af36fbb6-816a-4c85-af7e-f3ad85b888b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.107889 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-af36fbb6-816a-4c85-af7e-f3ad85b888b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.489404 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-af36fbb6-816a-4c85-af7e-f3ad85b888b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:54.506385 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-af36fbb6-816a-4c85-af7e-f3ad85b888b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.420337 Jul 18 16:51:54.508185 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 31/63] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:54 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:54.517843 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3549bf68-fb7e-4f7c-9633-f9936570ecb0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:54.521328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3549bf68-fb7e-4f7c-9633-f9936570ecb0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:54.536528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3549bf68-fb7e-4f7c-9633-f9936570ecb0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.537168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3549bf68-fb7e-4f7c-9633-f9936570ecb0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.540915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3549bf68-fb7e-4f7c-9633-f9936570ecb0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.540915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3549bf68-fb7e-4f7c-9633-f9936570ecb0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.554608 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-36a0a77e-514b-42f2-b9f1-50b8e4ea7cd9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:54.565112 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-36a0a77e-514b-42f2-b9f1-50b8e4ea7cd9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.526195 Jul 18 16:51:54.576502 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 33/64] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:54 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:54.582777 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1732e5b4-249c-4082-92a3-b300bb0cfcd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:54.589830 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1732e5b4-249c-4082-92a3-b300bb0cfcd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:54.600402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1732e5b4-249c-4082-92a3-b300bb0cfcd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.601116 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1732e5b4-249c-4082-92a3-b300bb0cfcd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.602054 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1732e5b4-249c-4082-92a3-b300bb0cfcd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.602500 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1732e5b4-249c-4082-92a3-b300bb0cfcd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.641965 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3549bf68-fb7e-4f7c-9633-f9936570ecb0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:54.651607 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3549bf68-fb7e-4f7c-9633-f9936570ecb0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1292 microversion: 2.1 time: 0.142301 Jul 18 16:51:54.652488 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 32/65] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:54 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1292 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:54.662990 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-50ad2c22-3331-4fb7-b1d9-851af439065b req-168d25e2-cc67-4302-a5d8-002cc484b11c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59aa6d7f-233d-4c0e-86ef-28eaba66c858", "tag": "e3a00be0-39ee-4ade-8902-fe1a84c9ca37"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:54.673028 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-50ad2c22-3331-4fb7-b1d9-851af439065b req-168d25e2-cc67-4302-a5d8-002cc484b11c service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.673882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-50ad2c22-3331-4fb7-b1d9-851af439065b req-168d25e2-cc67-4302-a5d8-002cc484b11c service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.698358 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-50ad2c22-3331-4fb7-b1d9-851af439065b req-168d25e2-cc67-4302-a5d8-002cc484b11c service nova] Creating event network-changed:e3a00be0-39ee-4ade-8902-fe1a84c9ca37 for instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 on hv-cinder-83754 Jul 18 16:51:54.704724 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-50ad2c22-3331-4fb7-b1d9-851af439065b req-168d25e2-cc67-4302-a5d8-002cc484b11c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051108 Jul 18 16:51:54.705735 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 33/66] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:54.715655 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-aa26d968-64a2-4acb-9fe4-47f314032ee0 req-0fe3c4e8-ef8f-4f8a-aff3-03c78e0edefb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0ce676-a485-4100-8afa-a6bc5efacf8f", "tag": "829b066e-4335-4351-899c-03b885192e39"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:54.731584 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-aa26d968-64a2-4acb-9fe4-47f314032ee0 req-0fe3c4e8-ef8f-4f8a-aff3-03c78e0edefb service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.732029 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-aa26d968-64a2-4acb-9fe4-47f314032ee0 req-0fe3c4e8-ef8f-4f8a-aff3-03c78e0edefb service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.752958 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-aa26d968-64a2-4acb-9fe4-47f314032ee0 req-0fe3c4e8-ef8f-4f8a-aff3-03c78e0edefb service nova] Creating event network-changed:829b066e-4335-4351-899c-03b885192e39 for instance 6b0ce676-a485-4100-8afa-a6bc5efacf8f on hv-cinder-83754 Jul 18 16:51:54.758483 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-aa26d968-64a2-4acb-9fe4-47f314032ee0 req-0fe3c4e8-ef8f-4f8a-aff3-03c78e0edefb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049829 Jul 18 16:51:54.759630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 34/67] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:54.837658 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1732e5b4-249c-4082-92a3-b300bb0cfcd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:54.848264 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1732e5b4-249c-4082-92a3-b300bb0cfcd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:54.850425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1732e5b4-249c-4082-92a3-b300bb0cfcd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:54.851874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1732e5b4-249c-4082-92a3-b300bb0cfcd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.279176 Jul 18 16:51:54.852548 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 34/68] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:54 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:51:55.524004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d8c37350-ebfe-4c46-a256-8b48b72197bf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:55.524706 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d8c37350-ebfe-4c46-a256-8b48b72197bf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:55.531931 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d8c37350-ebfe-4c46-a256-8b48b72197bf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.537788 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d8c37350-ebfe-4c46-a256-8b48b72197bf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.537788 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d8c37350-ebfe-4c46-a256-8b48b72197bf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.537788 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d8c37350-ebfe-4c46-a256-8b48b72197bf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.584840 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4cc1bad0-297d-40cb-9de4-9f159bbb4b8e tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:55.586089 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4cc1bad0-297d-40cb-9de4-9f159bbb4b8e tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:55.592501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4cc1bad0-297d-40cb-9de4-9f159bbb4b8e tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.592963 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4cc1bad0-297d-40cb-9de4-9f159bbb4b8e tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.594916 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4cc1bad0-297d-40cb-9de4-9f159bbb4b8e tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.595140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4cc1bad0-297d-40cb-9de4-9f159bbb4b8e tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.677484 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d8c37350-ebfe-4c46-a256-8b48b72197bf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:55.684896 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d8c37350-ebfe-4c46-a256-8b48b72197bf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.164980 Jul 18 16:51:55.685622 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 35/69] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:55 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:55.691644 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-487c9628-6fb7-4706-80e1-85d966558825 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:55.692391 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-487c9628-6fb7-4706-80e1-85d966558825 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:55.699574 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-487c9628-6fb7-4706-80e1-85d966558825 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.701982 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-487c9628-6fb7-4706-80e1-85d966558825 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.701982 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-487c9628-6fb7-4706-80e1-85d966558825 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.702167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-487c9628-6fb7-4706-80e1-85d966558825 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.751726 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4cc1bad0-297d-40cb-9de4-9f159bbb4b8e tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:55.763369 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4cc1bad0-297d-40cb-9de4-9f159bbb4b8e tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.183033 Jul 18 16:51:55.764229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 35/70] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:55 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:55.872426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ff5b163f-eba0-4f56-8ee1-aedef634b912 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:55.873082 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ff5b163f-eba0-4f56-8ee1-aedef634b912 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:55.881097 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff5b163f-eba0-4f56-8ee1-aedef634b912 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.881557 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff5b163f-eba0-4f56-8ee1-aedef634b912 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.883820 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff5b163f-eba0-4f56-8ee1-aedef634b912 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.887826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff5b163f-eba0-4f56-8ee1-aedef634b912 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.950067 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-487c9628-6fb7-4706-80e1-85d966558825 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:55.961928 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-487c9628-6fb7-4706-80e1-85d966558825 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1292 microversion: 2.1 time: 0.274835 Jul 18 16:51:55.969182 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 36/71] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:55 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1292 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:56.076122 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ff5b163f-eba0-4f56-8ee1-aedef634b912 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:56.085199 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ff5b163f-eba0-4f56-8ee1-aedef634b912 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:56.086732 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ff5b163f-eba0-4f56-8ee1-aedef634b912 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:56.087878 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ff5b163f-eba0-4f56-8ee1-aedef634b912 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.220841 Jul 18 16:51:56.088643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 36/72] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:55 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:51:56.703067 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e7eedb31-18cf-4611-ae79-a7a1ce83b92e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:56.704174 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e7eedb31-18cf-4611-ae79-a7a1ce83b92e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:56.705963 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:56.710793 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e7eedb31-18cf-4611-ae79-a7a1ce83b92e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:56.711251 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e7eedb31-18cf-4611-ae79-a7a1ce83b92e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:56.712067 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e7eedb31-18cf-4611-ae79-a7a1ce83b92e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:56.712509 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e7eedb31-18cf-4611-ae79-a7a1ce83b92e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:56.781996 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2c64a504-2cfb-49f5-9dc5-fd4382d83e69 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:56.783074 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2c64a504-2cfb-49f5-9dc5-fd4382d83e69 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:56.789491 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2c64a504-2cfb-49f5-9dc5-fd4382d83e69 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:56.790033 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2c64a504-2cfb-49f5-9dc5-fd4382d83e69 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:56.790879 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2c64a504-2cfb-49f5-9dc5-fd4382d83e69 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:56.791488 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2c64a504-2cfb-49f5-9dc5-fd4382d83e69 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:56.864921 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e7eedb31-18cf-4611-ae79-a7a1ce83b92e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:56.867167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:56.874369 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e7eedb31-18cf-4611-ae79-a7a1ce83b92e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.175646 Jul 18 16:51:56.885500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 37/73] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:56 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:56.953421 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2c64a504-2cfb-49f5-9dc5-fd4382d83e69 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:56.957153 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2c64a504-2cfb-49f5-9dc5-fd4382d83e69 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.179760 Jul 18 16:51:56.973003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 37/74] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:56 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:56.983261 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9a58008f-5ce1-4377-b65b-5dca2420b866 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:56.988726 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9a58008f-5ce1-4377-b65b-5dca2420b866 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:56.991823 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a58008f-5ce1-4377-b65b-5dca2420b866 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:56.992451 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a58008f-5ce1-4377-b65b-5dca2420b866 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:56.993273 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a58008f-5ce1-4377-b65b-5dca2420b866 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:56.993722 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a58008f-5ce1-4377-b65b-5dca2420b866 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:57.066358 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9a58008f-5ce1-4377-b65b-5dca2420b866 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:57.071834 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9a58008f-5ce1-4377-b65b-5dca2420b866 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1292 microversion: 2.1 time: 0.092330 Jul 18 16:51:57.072423 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 38/75] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:56 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:57.106725 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fa0f12bb-f03f-4615-ab20-983ee541b74f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:57.107466 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fa0f12bb-f03f-4615-ab20-983ee541b74f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:57.113997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa0f12bb-f03f-4615-ab20-983ee541b74f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:57.114442 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa0f12bb-f03f-4615-ab20-983ee541b74f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:57.115220 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa0f12bb-f03f-4615-ab20-983ee541b74f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:57.115658 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa0f12bb-f03f-4615-ab20-983ee541b74f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:57.273635 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fa0f12bb-f03f-4615-ab20-983ee541b74f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:57.281196 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fa0f12bb-f03f-4615-ab20-983ee541b74f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:57.282690 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fa0f12bb-f03f-4615-ab20-983ee541b74f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:57.283795 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fa0f12bb-f03f-4615-ab20-983ee541b74f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.181250 Jul 18 16:51:57.284348 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 38/76] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:57 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:51:57.895080 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-989b056b-0f50-446a-a69a-ba98cec5324f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:57.895721 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-989b056b-0f50-446a-a69a-ba98cec5324f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:57.902379 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-989b056b-0f50-446a-a69a-ba98cec5324f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:57.902832 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-989b056b-0f50-446a-a69a-ba98cec5324f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:57.903640 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-989b056b-0f50-446a-a69a-ba98cec5324f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:57.904079 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-989b056b-0f50-446a-a69a-ba98cec5324f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:57.974765 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d6614629-9c73-4be5-8845-1833233af5aa tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:57.975682 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d6614629-9c73-4be5-8845-1833233af5aa tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:57.982027 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d6614629-9c73-4be5-8845-1833233af5aa tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:57.982476 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d6614629-9c73-4be5-8845-1833233af5aa tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:57.983358 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d6614629-9c73-4be5-8845-1833233af5aa tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:57.983807 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d6614629-9c73-4be5-8845-1833233af5aa tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:58.044236 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-989b056b-0f50-446a-a69a-ba98cec5324f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:58.052898 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-989b056b-0f50-446a-a69a-ba98cec5324f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.162291 Jul 18 16:51:58.053453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 39/77] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:57 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:58.088662 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-94629bf5-b749-472c-ade7-ae1359a5b847 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:58.089344 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-94629bf5-b749-472c-ade7-ae1359a5b847 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:58.096817 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-94629bf5-b749-472c-ade7-ae1359a5b847 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:58.097433 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-94629bf5-b749-472c-ade7-ae1359a5b847 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:58.098522 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-94629bf5-b749-472c-ade7-ae1359a5b847 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:58.098997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-94629bf5-b749-472c-ade7-ae1359a5b847 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:58.136111 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d6614629-9c73-4be5-8845-1833233af5aa tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:58.144752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d6614629-9c73-4be5-8845-1833233af5aa tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.173886 Jul 18 16:51:58.145359 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 39/78] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:57 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:58.180599 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-94629bf5-b749-472c-ade7-ae1359a5b847 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:58.188719 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-94629bf5-b749-472c-ade7-ae1359a5b847 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1292 microversion: 2.1 time: 0.103880 Jul 18 16:51:58.189393 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 40/79] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:58 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1292 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:58.301505 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-45fe5fd4-b82c-4a11-9239-ea5d582fba6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:58.302123 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-45fe5fd4-b82c-4a11-9239-ea5d582fba6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:58.308317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45fe5fd4-b82c-4a11-9239-ea5d582fba6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:58.308772 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45fe5fd4-b82c-4a11-9239-ea5d582fba6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:58.309628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45fe5fd4-b82c-4a11-9239-ea5d582fba6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:58.310070 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45fe5fd4-b82c-4a11-9239-ea5d582fba6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:58.409892 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=20 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:58.459079 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-45fe5fd4-b82c-4a11-9239-ea5d582fba6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:58.467490 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-45fe5fd4-b82c-4a11-9239-ea5d582fba6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:58.469214 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-45fe5fd4-b82c-4a11-9239-ea5d582fba6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:58.470360 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-45fe5fd4-b82c-4a11-9239-ea5d582fba6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.173120 Jul 18 16:51:58.470912 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 40/80] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:58 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:51:59.070024 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1ea1776d-3cff-49b6-b7a7-0d54f457f11e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:59.070570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1ea1776d-3cff-49b6-b7a7-0d54f457f11e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:59.072393 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=5 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:59.077334 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ea1776d-3cff-49b6-b7a7-0d54f457f11e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.077930 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ea1776d-3cff-49b6-b7a7-0d54f457f11e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:59.078854 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ea1776d-3cff-49b6-b7a7-0d54f457f11e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.079300 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ea1776d-3cff-49b6-b7a7-0d54f457f11e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:59.161833 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-07ac3797-29b8-4363-8de1-af43346c8c81 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:59.162440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-07ac3797-29b8-4363-8de1-af43346c8c81 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:59.169255 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-07ac3797-29b8-4363-8de1-af43346c8c81 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.169927 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-07ac3797-29b8-4363-8de1-af43346c8c81 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:59.170709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-07ac3797-29b8-4363-8de1-af43346c8c81 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.171143 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-07ac3797-29b8-4363-8de1-af43346c8c81 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:59.214944 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1ea1776d-3cff-49b6-b7a7-0d54f457f11e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:59.223244 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1ea1776d-3cff-49b6-b7a7-0d54f457f11e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.157076 Jul 18 16:51:59.223853 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 41/81] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:59 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:59.228354 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2411b148-105a-4d8f-a751-80fea655602e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:59.229237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2411b148-105a-4d8f-a751-80fea655602e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:59.236189 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2411b148-105a-4d8f-a751-80fea655602e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.236645 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2411b148-105a-4d8f-a751-80fea655602e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:59.237511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2411b148-105a-4d8f-a751-80fea655602e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.237986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2411b148-105a-4d8f-a751-80fea655602e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:59.302189 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2411b148-105a-4d8f-a751-80fea655602e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:59.307929 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-07ac3797-29b8-4363-8de1-af43346c8c81 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:59.310106 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2411b148-105a-4d8f-a751-80fea655602e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1292 microversion: 2.1 time: 0.085257 Jul 18 16:51:59.310685 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 42/82] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:59 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:59.315604 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-07ac3797-29b8-4363-8de1-af43346c8c81 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.157953 Jul 18 16:51:59.316176 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 41/83] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:59 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:59.497401 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-03664125-129f-41d5-9546-d65db4b11668 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:59.498006 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-03664125-129f-41d5-9546-d65db4b11668 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:59.504922 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-03664125-129f-41d5-9546-d65db4b11668 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.505465 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-03664125-129f-41d5-9546-d65db4b11668 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:59.506248 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-03664125-129f-41d5-9546-d65db4b11668 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.506725 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-03664125-129f-41d5-9546-d65db4b11668 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:59.663436 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-03664125-129f-41d5-9546-d65db4b11668 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:59.674124 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-03664125-129f-41d5-9546-d65db4b11668 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:59.675737 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-03664125-129f-41d5-9546-d65db4b11668 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:59.677220 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-03664125-129f-41d5-9546-d65db4b11668 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.183629 Jul 18 16:51:59.689193 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 43/84] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:51:59 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:52:00.239839 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f6c36527-47b0-4508-b611-32a934970fda tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:00.248014 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f6c36527-47b0-4508-b611-32a934970fda tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:00.252148 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f6c36527-47b0-4508-b611-32a934970fda tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:00.252623 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f6c36527-47b0-4508-b611-32a934970fda tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:00.253479 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f6c36527-47b0-4508-b611-32a934970fda tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:00.253934 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f6c36527-47b0-4508-b611-32a934970fda tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:00.328973 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6d382c48-32b1-4793-bb72-34ae2d5dadcf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:00.330480 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6d382c48-32b1-4793-bb72-34ae2d5dadcf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:00.336688 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6d382c48-32b1-4793-bb72-34ae2d5dadcf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:00.337402 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6d382c48-32b1-4793-bb72-34ae2d5dadcf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:00.338271 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6d382c48-32b1-4793-bb72-34ae2d5dadcf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:00.338781 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6d382c48-32b1-4793-bb72-34ae2d5dadcf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:00.427441 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6d382c48-32b1-4793-bb72-34ae2d5dadcf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:00.436026 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6d382c48-32b1-4793-bb72-34ae2d5dadcf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1292 microversion: 2.1 time: 0.111922 Jul 18 16:52:00.445919 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 44/85] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:00 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1292 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:00.445919 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f48b2e4d-0dd4-4045-90c0-dd73017f1f12 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:00.445919 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f48b2e4d-0dd4-4045-90c0-dd73017f1f12 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:00.450010 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f48b2e4d-0dd4-4045-90c0-dd73017f1f12 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:00.450484 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f48b2e4d-0dd4-4045-90c0-dd73017f1f12 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:00.451505 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f48b2e4d-0dd4-4045-90c0-dd73017f1f12 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:00.453327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f48b2e4d-0dd4-4045-90c0-dd73017f1f12 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:00.537294 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f6c36527-47b0-4508-b611-32a934970fda tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:00.551503 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f6c36527-47b0-4508-b611-32a934970fda tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.315388 Jul 18 16:52:00.552665 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 42/86] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:00 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:00.695798 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ec39acba-8293-4310-b28c-8193386675d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:00.696417 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ec39acba-8293-4310-b28c-8193386675d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:00.704863 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec39acba-8293-4310-b28c-8193386675d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:00.706825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec39acba-8293-4310-b28c-8193386675d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:00.706825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec39acba-8293-4310-b28c-8193386675d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:00.706825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec39acba-8293-4310-b28c-8193386675d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:00.743959 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f48b2e4d-0dd4-4045-90c0-dd73017f1f12 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:00.758265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f48b2e4d-0dd4-4045-90c0-dd73017f1f12 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.319553 Jul 18 16:52:00.760757 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 45/87] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:00 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:00.876152 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ec39acba-8293-4310-b28c-8193386675d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:00.884320 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ec39acba-8293-4310-b28c-8193386675d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:00.885857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ec39acba-8293-4310-b28c-8193386675d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:00.886963 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ec39acba-8293-4310-b28c-8193386675d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.195145 Jul 18 16:52:00.887517 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 43/88] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:00 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:52:01.454472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f0841e99-965f-45fc-9912-1202fa05afd3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:01.455086 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f0841e99-965f-45fc-9912-1202fa05afd3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:01.466553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f0841e99-965f-45fc-9912-1202fa05afd3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:01.467009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f0841e99-965f-45fc-9912-1202fa05afd3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:01.467794 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f0841e99-965f-45fc-9912-1202fa05afd3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:01.468274 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f0841e99-965f-45fc-9912-1202fa05afd3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:01.534718 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f0841e99-965f-45fc-9912-1202fa05afd3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:01.542179 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f0841e99-965f-45fc-9912-1202fa05afd3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1310 microversion: 2.1 time: 0.092771 Jul 18 16:52:01.542803 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 46/89] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:01 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:01.569192 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-314c33a9-524c-449d-81df-53ffe8050f9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:01.569811 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-314c33a9-524c-449d-81df-53ffe8050f9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:01.575869 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-314c33a9-524c-449d-81df-53ffe8050f9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:01.576320 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-314c33a9-524c-449d-81df-53ffe8050f9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:01.577107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-314c33a9-524c-449d-81df-53ffe8050f9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:01.577572 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-314c33a9-524c-449d-81df-53ffe8050f9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:01.776799 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7a9aacf0-4ebe-4cb9-bebe-75651f2cccc0 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:01.776960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-314c33a9-524c-449d-81df-53ffe8050f9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:01.777807 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7a9aacf0-4ebe-4cb9-bebe-75651f2cccc0 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:01.786053 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a9aacf0-4ebe-4cb9-bebe-75651f2cccc0 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:01.786747 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a9aacf0-4ebe-4cb9-bebe-75651f2cccc0 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:01.787718 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a9aacf0-4ebe-4cb9-bebe-75651f2cccc0 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:01.788315 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a9aacf0-4ebe-4cb9-bebe-75651f2cccc0 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:01.788792 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-314c33a9-524c-449d-81df-53ffe8050f9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.223415 Jul 18 16:52:01.790778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 44/90] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:01 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:01.905511 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2ade107a-6dd4-4090-8d56-057194a493b8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:01.906706 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2ade107a-6dd4-4090-8d56-057194a493b8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:01.914260 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ade107a-6dd4-4090-8d56-057194a493b8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:01.914751 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ade107a-6dd4-4090-8d56-057194a493b8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:01.915546 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ade107a-6dd4-4090-8d56-057194a493b8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:01.915986 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ade107a-6dd4-4090-8d56-057194a493b8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:02.009269 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7a9aacf0-4ebe-4cb9-bebe-75651f2cccc0 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:02.022416 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7a9aacf0-4ebe-4cb9-bebe-75651f2cccc0 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.249420 Jul 18 16:52:02.023651 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 47/91] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:01 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:02.097148 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2ade107a-6dd4-4090-8d56-057194a493b8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:02.101201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:02.106528 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2ade107a-6dd4-4090-8d56-057194a493b8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:02.108019 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2ade107a-6dd4-4090-8d56-057194a493b8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:02.109872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2ade107a-6dd4-4090-8d56-057194a493b8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.207443 Jul 18 16:52:02.110442 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 45/92] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:01 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:52:02.559911 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-273bfe3d-00b7-4911-8f21-b24e6fa07afd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:02.560530 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-273bfe3d-00b7-4911-8f21-b24e6fa07afd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:02.567313 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-273bfe3d-00b7-4911-8f21-b24e6fa07afd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:02.567771 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-273bfe3d-00b7-4911-8f21-b24e6fa07afd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:02.568547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-273bfe3d-00b7-4911-8f21-b24e6fa07afd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:02.569193 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-273bfe3d-00b7-4911-8f21-b24e6fa07afd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:02.705345 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-273bfe3d-00b7-4911-8f21-b24e6fa07afd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:02.714021 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-273bfe3d-00b7-4911-8f21-b24e6fa07afd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.158151 Jul 18 16:52:02.714590 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 48/93] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:02 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:02.807462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-41dfefe4-2679-4e44-a999-08f66403e9c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:02.808072 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-41dfefe4-2679-4e44-a999-08f66403e9c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:02.814769 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41dfefe4-2679-4e44-a999-08f66403e9c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:02.815250 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41dfefe4-2679-4e44-a999-08f66403e9c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:02.816013 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41dfefe4-2679-4e44-a999-08f66403e9c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:02.816447 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41dfefe4-2679-4e44-a999-08f66403e9c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:02.959068 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-41dfefe4-2679-4e44-a999-08f66403e9c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:02.966803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-41dfefe4-2679-4e44-a999-08f66403e9c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.163508 Jul 18 16:52:02.979154 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 46/94] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:02 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:03.050707 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-22e2ad19-5bb7-4faf-8337-99f02febc7f8 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:03.050707 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-22e2ad19-5bb7-4faf-8337-99f02febc7f8 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:03.050707 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22e2ad19-5bb7-4faf-8337-99f02febc7f8 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.050707 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22e2ad19-5bb7-4faf-8337-99f02febc7f8 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.051125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22e2ad19-5bb7-4faf-8337-99f02febc7f8 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.051722 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22e2ad19-5bb7-4faf-8337-99f02febc7f8 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.129744 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-088adc0d-1195-4396-a85f-deed57f49ea8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:03.130745 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-088adc0d-1195-4396-a85f-deed57f49ea8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:03.137613 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-088adc0d-1195-4396-a85f-deed57f49ea8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.138460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-088adc0d-1195-4396-a85f-deed57f49ea8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.139696 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-088adc0d-1195-4396-a85f-deed57f49ea8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.140385 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-088adc0d-1195-4396-a85f-deed57f49ea8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.291314 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-22e2ad19-5bb7-4faf-8337-99f02febc7f8 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:03.301525 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-22e2ad19-5bb7-4faf-8337-99f02febc7f8 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.265591 Jul 18 16:52:03.302789 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 49/95] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:03 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:03.356251 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-088adc0d-1195-4396-a85f-deed57f49ea8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:03.368368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-088adc0d-1195-4396-a85f-deed57f49ea8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:03.371172 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-088adc0d-1195-4396-a85f-deed57f49ea8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:03.372918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-088adc0d-1195-4396-a85f-deed57f49ea8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.248738 Jul 18 16:52:03.375886 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 47/96] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:03 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:52:03.442032 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-33bbc730-6566-4967-b7cb-0fed8f2edfd4 req-44ecdee8-faa1-418c-8398-cb538a40735f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dd8e166-14c8-46d5-80a3-a70d57745265", "name": "network-vif-plugged", "status": "completed", "tag": "11b787d6-ea05-4fdd-affb-4ab3787f16ab"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:03.450354 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-33bbc730-6566-4967-b7cb-0fed8f2edfd4 req-44ecdee8-faa1-418c-8398-cb538a40735f service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.451057 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-33bbc730-6566-4967-b7cb-0fed8f2edfd4 req-44ecdee8-faa1-418c-8398-cb538a40735f service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.463660 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-33bbc730-6566-4967-b7cb-0fed8f2edfd4 req-44ecdee8-faa1-418c-8398-cb538a40735f service nova] Creating event network-vif-plugged:11b787d6-ea05-4fdd-affb-4ab3787f16ab for instance 4dd8e166-14c8-46d5-80a3-a70d57745265 on hv-cinder-83754 Jul 18 16:52:03.469653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-33bbc730-6566-4967-b7cb-0fed8f2edfd4 req-44ecdee8-faa1-418c-8398-cb538a40735f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096496 Jul 18 16:52:03.470333 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 50/97] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:52:03.732626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5b12e1ec-2834-41ff-ad23-5e95e980f837 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:03.733358 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5b12e1ec-2834-41ff-ad23-5e95e980f837 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:03.740607 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5b12e1ec-2834-41ff-ad23-5e95e980f837 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.741105 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5b12e1ec-2834-41ff-ad23-5e95e980f837 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.741870 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5b12e1ec-2834-41ff-ad23-5e95e980f837 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.742308 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5b12e1ec-2834-41ff-ad23-5e95e980f837 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.883930 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5b12e1ec-2834-41ff-ad23-5e95e980f837 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:03.891598 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5b12e1ec-2834-41ff-ad23-5e95e980f837 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.163540 Jul 18 16:52:03.892172 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 48/98] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:03 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:03.986023 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9c5e5b9d-c6ac-43d1-b314-94d9ae4eb702 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:03.986616 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9c5e5b9d-c6ac-43d1-b314-94d9ae4eb702 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:03.992375 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c5e5b9d-c6ac-43d1-b314-94d9ae4eb702 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.992823 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c5e5b9d-c6ac-43d1-b314-94d9ae4eb702 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.993634 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c5e5b9d-c6ac-43d1-b314-94d9ae4eb702 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.994072 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c5e5b9d-c6ac-43d1-b314-94d9ae4eb702 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:04.128675 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9c5e5b9d-c6ac-43d1-b314-94d9ae4eb702 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:04.136161 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9c5e5b9d-c6ac-43d1-b314-94d9ae4eb702 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.155175 Jul 18 16:52:04.136723 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 51/99] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:03 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:04.320210 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-397687f6-c86e-453c-a848-e7fa8cc12a66 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:04.320816 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-397687f6-c86e-453c-a848-e7fa8cc12a66 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:04.322748 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:04.328304 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-397687f6-c86e-453c-a848-e7fa8cc12a66 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:04.328766 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-397687f6-c86e-453c-a848-e7fa8cc12a66 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:04.329643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-397687f6-c86e-453c-a848-e7fa8cc12a66 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:04.330083 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-397687f6-c86e-453c-a848-e7fa8cc12a66 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:04.392400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f7c6c293-9f7b-46a4-8fe2-ad0cee5b7354 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:04.393103 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f7c6c293-9f7b-46a4-8fe2-ad0cee5b7354 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:04.399414 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7c6c293-9f7b-46a4-8fe2-ad0cee5b7354 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:04.399868 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7c6c293-9f7b-46a4-8fe2-ad0cee5b7354 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:04.400674 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7c6c293-9f7b-46a4-8fe2-ad0cee5b7354 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:04.401250 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7c6c293-9f7b-46a4-8fe2-ad0cee5b7354 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:04.468337 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-397687f6-c86e-453c-a848-e7fa8cc12a66 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:04.475924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-397687f6-c86e-453c-a848-e7fa8cc12a66 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.159618 Jul 18 16:52:04.476508 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 49/100] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:04 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:04.532193 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f7c6c293-9f7b-46a4-8fe2-ad0cee5b7354 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:04.540233 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f7c6c293-9f7b-46a4-8fe2-ad0cee5b7354 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:04.541782 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f7c6c293-9f7b-46a4-8fe2-ad0cee5b7354 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:04.542889 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f7c6c293-9f7b-46a4-8fe2-ad0cee5b7354 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.155428 Jul 18 16:52:04.543438 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 52/101] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:04 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:52:04.914425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6386e977-2bfe-427f-bfdc-b9d406badb8f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:04.914425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6386e977-2bfe-427f-bfdc-b9d406badb8f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:04.916431 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6386e977-2bfe-427f-bfdc-b9d406badb8f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:04.916884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6386e977-2bfe-427f-bfdc-b9d406badb8f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:04.917875 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6386e977-2bfe-427f-bfdc-b9d406badb8f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:04.918280 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6386e977-2bfe-427f-bfdc-b9d406badb8f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:05.055466 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6386e977-2bfe-427f-bfdc-b9d406badb8f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:05.063464 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6386e977-2bfe-427f-bfdc-b9d406badb8f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.159590 Jul 18 16:52:05.064028 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 50/102] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:04 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:05.156906 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b5384ab3-d6bf-4554-a3a2-5e5f7f5dadb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:05.158140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b5384ab3-d6bf-4554-a3a2-5e5f7f5dadb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:05.164676 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b5384ab3-d6bf-4554-a3a2-5e5f7f5dadb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:05.165225 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b5384ab3-d6bf-4554-a3a2-5e5f7f5dadb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:05.165999 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b5384ab3-d6bf-4554-a3a2-5e5f7f5dadb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:05.166397 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b5384ab3-d6bf-4554-a3a2-5e5f7f5dadb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:05.310692 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b5384ab3-d6bf-4554-a3a2-5e5f7f5dadb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:05.318594 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b5384ab3-d6bf-4554-a3a2-5e5f7f5dadb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.168491 Jul 18 16:52:05.320222 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 53/103] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:05 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:05.502477 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ab225976-77ad-4033-a882-eddba7da49c7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:05.503280 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ab225976-77ad-4033-a882-eddba7da49c7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:05.509769 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ab225976-77ad-4033-a882-eddba7da49c7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:05.510458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ab225976-77ad-4033-a882-eddba7da49c7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:05.511246 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ab225976-77ad-4033-a882-eddba7da49c7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:05.511687 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ab225976-77ad-4033-a882-eddba7da49c7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:05.561925 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0dba667b-4237-46ac-9761-d9639e10ed49 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:05.562698 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0dba667b-4237-46ac-9761-d9639e10ed49 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:05.569527 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0dba667b-4237-46ac-9761-d9639e10ed49 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:05.570059 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0dba667b-4237-46ac-9761-d9639e10ed49 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:05.570911 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0dba667b-4237-46ac-9761-d9639e10ed49 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:05.571471 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0dba667b-4237-46ac-9761-d9639e10ed49 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:05.733800 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0dba667b-4237-46ac-9761-d9639e10ed49 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:05.742871 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ab225976-77ad-4033-a882-eddba7da49c7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:05.744490 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0dba667b-4237-46ac-9761-d9639e10ed49 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:05.746126 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0dba667b-4237-46ac-9761-d9639e10ed49 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:05.747269 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0dba667b-4237-46ac-9761-d9639e10ed49 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.189376 Jul 18 16:52:05.748021 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 54/104] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:05 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:52:05.752075 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ab225976-77ad-4033-a882-eddba7da49c7 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.261925 Jul 18 16:52:05.752726 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 51/105] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:05 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:06.080981 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a9aacf41-1555-41e1-b472-c6e354dab956 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:06.081694 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a9aacf41-1555-41e1-b472-c6e354dab956 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:06.087756 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9aacf41-1555-41e1-b472-c6e354dab956 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:06.088201 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9aacf41-1555-41e1-b472-c6e354dab956 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:06.088955 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9aacf41-1555-41e1-b472-c6e354dab956 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:06.089474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9aacf41-1555-41e1-b472-c6e354dab956 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:06.094297 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:06.229949 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a9aacf41-1555-41e1-b472-c6e354dab956 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:06.242505 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a9aacf41-1555-41e1-b472-c6e354dab956 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.165953 Jul 18 16:52:06.252053 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 55/106] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:06 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:06.335900 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-26145531-26dd-457d-98b8-88cfead8b3f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:06.336619 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-26145531-26dd-457d-98b8-88cfead8b3f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:06.344841 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26145531-26dd-457d-98b8-88cfead8b3f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:06.345332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26145531-26dd-457d-98b8-88cfead8b3f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:06.346237 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26145531-26dd-457d-98b8-88cfead8b3f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:06.346807 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26145531-26dd-457d-98b8-88cfead8b3f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:06.488568 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-26145531-26dd-457d-98b8-88cfead8b3f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:06.496156 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-26145531-26dd-457d-98b8-88cfead8b3f8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.164265 Jul 18 16:52:06.496728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 52/107] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:06 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:06.775322 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dfd12078-546f-426d-85bc-2d8f1b7b6e72 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:06.776329 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-657dfaee-8b77-4d4b-9576-cf3a00382885 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:06.776630 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dfd12078-546f-426d-85bc-2d8f1b7b6e72 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:06.777894 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-657dfaee-8b77-4d4b-9576-cf3a00382885 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:06.787638 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dfd12078-546f-426d-85bc-2d8f1b7b6e72 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:06.788102 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dfd12078-546f-426d-85bc-2d8f1b7b6e72 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:06.788889 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dfd12078-546f-426d-85bc-2d8f1b7b6e72 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:06.789378 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dfd12078-546f-426d-85bc-2d8f1b7b6e72 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:06.792683 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-657dfaee-8b77-4d4b-9576-cf3a00382885 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:06.793715 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-657dfaee-8b77-4d4b-9576-cf3a00382885 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:06.795267 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-657dfaee-8b77-4d4b-9576-cf3a00382885 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:06.796295 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-657dfaee-8b77-4d4b-9576-cf3a00382885 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:07.176467 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-657dfaee-8b77-4d4b-9576-cf3a00382885 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:07.203987 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-657dfaee-8b77-4d4b-9576-cf3a00382885 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:07.207284 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-657dfaee-8b77-4d4b-9576-cf3a00382885 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:07.209357 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-657dfaee-8b77-4d4b-9576-cf3a00382885 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.444081 Jul 18 16:52:07.213098 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 56/108] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:06 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:52:07.263179 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b36401c9-3bc2-4ebf-b38b-ce4f598f1337 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:07.264235 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b36401c9-3bc2-4ebf-b38b-ce4f598f1337 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:07.276624 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b36401c9-3bc2-4ebf-b38b-ce4f598f1337 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:07.277589 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b36401c9-3bc2-4ebf-b38b-ce4f598f1337 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:07.283743 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b36401c9-3bc2-4ebf-b38b-ce4f598f1337 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:07.283743 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b36401c9-3bc2-4ebf-b38b-ce4f598f1337 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:07.508141 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b36401c9-3bc2-4ebf-b38b-ce4f598f1337 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:07.544142 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b36401c9-3bc2-4ebf-b38b-ce4f598f1337 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.281788 Jul 18 16:52:07.544142 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 57/109] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:07 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:07.558083 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0ac8e4a5-127e-4eff-b848-8bcafb2be85f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:07.561861 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0ac8e4a5-127e-4eff-b848-8bcafb2be85f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:07.578863 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0ac8e4a5-127e-4eff-b848-8bcafb2be85f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:07.582118 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0ac8e4a5-127e-4eff-b848-8bcafb2be85f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:07.583953 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0ac8e4a5-127e-4eff-b848-8bcafb2be85f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:07.584557 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0ac8e4a5-127e-4eff-b848-8bcafb2be85f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:07.715488 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dfd12078-546f-426d-85bc-2d8f1b7b6e72 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:07.728254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dfd12078-546f-426d-85bc-2d8f1b7b6e72 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.963142 Jul 18 16:52:07.729604 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 53/110] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:06 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:07.860712 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0ac8e4a5-127e-4eff-b848-8bcafb2be85f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:07.869078 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0ac8e4a5-127e-4eff-b848-8bcafb2be85f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.322952 Jul 18 16:52:07.872151 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 58/111] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:07 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:08.101455 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-a40454a6-e6d9-467c-becc-ce030f9843a1 req-b8f66bbf-9fc9-439b-b588-4441422e72f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57c0d06-7394-47d2-ab8b-2445e996c9bd", "tag": "d7caf253-581a-4f92-93cf-cb4bd4b4b2a3"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:08.129595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-a40454a6-e6d9-467c-becc-ce030f9843a1 req-b8f66bbf-9fc9-439b-b588-4441422e72f0 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:08.129595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-a40454a6-e6d9-467c-becc-ce030f9843a1 req-b8f66bbf-9fc9-439b-b588-4441422e72f0 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.177768 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-a40454a6-e6d9-467c-becc-ce030f9843a1 req-b8f66bbf-9fc9-439b-b588-4441422e72f0 service nova] Creating event network-changed:d7caf253-581a-4f92-93cf-cb4bd4b4b2a3 for instance b57c0d06-7394-47d2-ab8b-2445e996c9bd on hv-cinder-83754 Jul 18 16:52:08.192754 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-a40454a6-e6d9-467c-becc-ce030f9843a1 req-b8f66bbf-9fc9-439b-b588-4441422e72f0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099713 Jul 18 16:52:08.194909 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 54/112] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:52:08.229947 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4f9d0a2a-34f8-4de7-abb4-e3ae5c08cc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:08.230903 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4f9d0a2a-34f8-4de7-abb4-e3ae5c08cc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:08.239194 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f9d0a2a-34f8-4de7-abb4-e3ae5c08cc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:08.243609 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f9d0a2a-34f8-4de7-abb4-e3ae5c08cc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.244631 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f9d0a2a-34f8-4de7-abb4-e3ae5c08cc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:08.245272 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f9d0a2a-34f8-4de7-abb4-e3ae5c08cc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.440456 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4f9d0a2a-34f8-4de7-abb4-e3ae5c08cc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:08.448724 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4f9d0a2a-34f8-4de7-abb4-e3ae5c08cc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:08.450262 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4f9d0a2a-34f8-4de7-abb4-e3ae5c08cc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:08.451405 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4f9d0a2a-34f8-4de7-abb4-e3ae5c08cc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.225674 Jul 18 16:52:08.451963 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 59/113] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:08 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:52:08.559115 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f42499a8-4d80-4b38-a7fa-54e0aa269d30 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:08.559828 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f42499a8-4d80-4b38-a7fa-54e0aa269d30 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:08.567574 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f42499a8-4d80-4b38-a7fa-54e0aa269d30 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:08.568349 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f42499a8-4d80-4b38-a7fa-54e0aa269d30 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.571480 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f42499a8-4d80-4b38-a7fa-54e0aa269d30 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:08.571480 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f42499a8-4d80-4b38-a7fa-54e0aa269d30 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.730237 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f42499a8-4d80-4b38-a7fa-54e0aa269d30 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:08.737970 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f42499a8-4d80-4b38-a7fa-54e0aa269d30 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.183548 Jul 18 16:52:08.738539 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 55/114] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:08 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:08.751799 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2742bf8e-8bda-478e-bf11-59fa2286671d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:08.752449 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2742bf8e-8bda-478e-bf11-59fa2286671d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:08.758736 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2742bf8e-8bda-478e-bf11-59fa2286671d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:08.759187 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2742bf8e-8bda-478e-bf11-59fa2286671d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.759961 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2742bf8e-8bda-478e-bf11-59fa2286671d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:08.760398 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2742bf8e-8bda-478e-bf11-59fa2286671d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.889705 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5f8b49bd-25e0-4df6-a49c-dbaed2d06cb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:08.892182 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5f8b49bd-25e0-4df6-a49c-dbaed2d06cb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:08.900312 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f8b49bd-25e0-4df6-a49c-dbaed2d06cb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:08.901093 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f8b49bd-25e0-4df6-a49c-dbaed2d06cb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.902082 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f8b49bd-25e0-4df6-a49c-dbaed2d06cb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:08.903228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f8b49bd-25e0-4df6-a49c-dbaed2d06cb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.923080 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2742bf8e-8bda-478e-bf11-59fa2286671d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:08.931928 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2742bf8e-8bda-478e-bf11-59fa2286671d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.187086 Jul 18 16:52:08.946249 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 60/115] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:08 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:09.072268 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5f8b49bd-25e0-4df6-a49c-dbaed2d06cb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:09.084025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5f8b49bd-25e0-4df6-a49c-dbaed2d06cb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.195714 Jul 18 16:52:09.084025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 56/116] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:08 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:09.376261 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-5d19778b-6c8d-4df3-954b-3afcab817db0 req-277fd2eb-6d7a-4459-9780-eee476402f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d31815-4f8c-4e76-adcb-8039b88488d0", "name": "network-vif-plugged", "status": "completed", "tag": "cbb20d80-19a9-48b1-be96-866c4a0904d4"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:09.387503 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:09.393694 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-5d19778b-6c8d-4df3-954b-3afcab817db0 req-277fd2eb-6d7a-4459-9780-eee476402f9e service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.394146 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-5d19778b-6c8d-4df3-954b-3afcab817db0 req-277fd2eb-6d7a-4459-9780-eee476402f9e service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:09.406513 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-5d19778b-6c8d-4df3-954b-3afcab817db0 req-277fd2eb-6d7a-4459-9780-eee476402f9e service nova] Creating event network-vif-plugged:cbb20d80-19a9-48b1-be96-866c4a0904d4 for instance c3d31815-4f8c-4e76-adcb-8039b88488d0 on hv-cinder-83754 Jul 18 16:52:09.413847 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-5d19778b-6c8d-4df3-954b-3afcab817db0 req-277fd2eb-6d7a-4459-9780-eee476402f9e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042167 Jul 18 16:52:09.414457 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 61/117] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:52:09.470124 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-199acebf-1499-4286-a355-0932e76aacca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:09.470729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-199acebf-1499-4286-a355-0932e76aacca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:09.490871 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-199acebf-1499-4286-a355-0932e76aacca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.491689 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-199acebf-1499-4286-a355-0932e76aacca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:09.494041 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-199acebf-1499-4286-a355-0932e76aacca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.495008 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-199acebf-1499-4286-a355-0932e76aacca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:09.674599 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-199acebf-1499-4286-a355-0932e76aacca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:09.682957 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-199acebf-1499-4286-a355-0932e76aacca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:09.684440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-199acebf-1499-4286-a355-0932e76aacca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:09.685662 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-199acebf-1499-4286-a355-0932e76aacca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.219517 Jul 18 16:52:09.686223 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 57/118] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:09 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:52:09.757629 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-89e601d2-8b12-4fde-96cc-8109ec6ad537 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:09.758335 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-89e601d2-8b12-4fde-96cc-8109ec6ad537 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:09.764941 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89e601d2-8b12-4fde-96cc-8109ec6ad537 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.765990 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89e601d2-8b12-4fde-96cc-8109ec6ad537 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:09.767153 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89e601d2-8b12-4fde-96cc-8109ec6ad537 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.767809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89e601d2-8b12-4fde-96cc-8109ec6ad537 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:09.911697 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-89e601d2-8b12-4fde-96cc-8109ec6ad537 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:09.925714 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-89e601d2-8b12-4fde-96cc-8109ec6ad537 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.172171 Jul 18 16:52:09.926819 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 62/119] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:09 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:09.951451 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b337547a-9523-4bb7-9b7a-bd53046ebf7d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:09.953488 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b337547a-9523-4bb7-9b7a-bd53046ebf7d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:09.962108 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b337547a-9523-4bb7-9b7a-bd53046ebf7d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.965906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b337547a-9523-4bb7-9b7a-bd53046ebf7d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:09.965906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b337547a-9523-4bb7-9b7a-bd53046ebf7d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.965906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b337547a-9523-4bb7-9b7a-bd53046ebf7d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:10.102131 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-902ae4a5-0a55-49d2-9080-de159176c014 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:10.102837 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-902ae4a5-0a55-49d2-9080-de159176c014 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:10.113355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-902ae4a5-0a55-49d2-9080-de159176c014 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:10.115868 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-902ae4a5-0a55-49d2-9080-de159176c014 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:10.117770 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-902ae4a5-0a55-49d2-9080-de159176c014 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:10.118422 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-902ae4a5-0a55-49d2-9080-de159176c014 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:10.143563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b337547a-9523-4bb7-9b7a-bd53046ebf7d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:10.160341 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b337547a-9523-4bb7-9b7a-bd53046ebf7d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.213116 Jul 18 16:52:10.170206 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 58/120] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:09 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:10.279936 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-902ae4a5-0a55-49d2-9080-de159176c014 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:10.288222 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-902ae4a5-0a55-49d2-9080-de159176c014 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.191900 Jul 18 16:52:10.288798 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 63/121] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:10 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:10.704333 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e8cf40f5-00f8-4a4d-a0c0-02bc7a46d05a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:10.704969 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e8cf40f5-00f8-4a4d-a0c0-02bc7a46d05a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:10.711276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e8cf40f5-00f8-4a4d-a0c0-02bc7a46d05a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:10.711823 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e8cf40f5-00f8-4a4d-a0c0-02bc7a46d05a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:10.712502 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e8cf40f5-00f8-4a4d-a0c0-02bc7a46d05a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:10.712936 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e8cf40f5-00f8-4a4d-a0c0-02bc7a46d05a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:10.852496 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e8cf40f5-00f8-4a4d-a0c0-02bc7a46d05a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:10.862052 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e8cf40f5-00f8-4a4d-a0c0-02bc7a46d05a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:10.863492 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e8cf40f5-00f8-4a4d-a0c0-02bc7a46d05a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:10.864592 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e8cf40f5-00f8-4a4d-a0c0-02bc7a46d05a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.164901 Jul 18 16:52:10.865177 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 59/122] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:10 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:52:10.946570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-87eee3c0-9fb2-4ae1-92ea-d52aa2db4392 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:10.946570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-87eee3c0-9fb2-4ae1-92ea-d52aa2db4392 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:10.951731 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-87eee3c0-9fb2-4ae1-92ea-d52aa2db4392 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:10.952148 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-87eee3c0-9fb2-4ae1-92ea-d52aa2db4392 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:10.952960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-87eee3c0-9fb2-4ae1-92ea-d52aa2db4392 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:10.953791 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-87eee3c0-9fb2-4ae1-92ea-d52aa2db4392 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.094342 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-87eee3c0-9fb2-4ae1-92ea-d52aa2db4392 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:11.104871 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-87eee3c0-9fb2-4ae1-92ea-d52aa2db4392 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.164921 Jul 18 16:52:11.105488 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 64/123] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:10 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:11.179031 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-eed97c46-0865-4028-91cc-3e5c906b481d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:11.179674 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-eed97c46-0865-4028-91cc-3e5c906b481d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:11.186172 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eed97c46-0865-4028-91cc-3e5c906b481d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:11.186620 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eed97c46-0865-4028-91cc-3e5c906b481d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.187486 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eed97c46-0865-4028-91cc-3e5c906b481d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:11.187964 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eed97c46-0865-4028-91cc-3e5c906b481d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.306858 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d66a3906-bcd9-467e-87d3-d6d0fce52a0d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:11.307479 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d66a3906-bcd9-467e-87d3-d6d0fce52a0d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:11.314033 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d66a3906-bcd9-467e-87d3-d6d0fce52a0d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:11.314485 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d66a3906-bcd9-467e-87d3-d6d0fce52a0d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.315257 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d66a3906-bcd9-467e-87d3-d6d0fce52a0d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:11.315692 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d66a3906-bcd9-467e-87d3-d6d0fce52a0d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.342803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-eed97c46-0865-4028-91cc-3e5c906b481d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:11.353748 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-eed97c46-0865-4028-91cc-3e5c906b481d tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.178534 Jul 18 16:52:11.354588 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 60/124] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:11 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:11.445150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-88a6fdab-c352-4a98-b8b1-3f8eb7951783 req-004482d1-1822-4fe3-8cbc-0d33dbe05aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59aa6d7f-233d-4c0e-86ef-28eaba66c858", "name": "network-vif-plugged", "status": "completed", "tag": "e3a00be0-39ee-4ade-8902-fe1a84c9ca37"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:11.464743 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-88a6fdab-c352-4a98-b8b1-3f8eb7951783 req-004482d1-1822-4fe3-8cbc-0d33dbe05aa7 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:11.465208 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-88a6fdab-c352-4a98-b8b1-3f8eb7951783 req-004482d1-1822-4fe3-8cbc-0d33dbe05aa7 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.486118 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-88a6fdab-c352-4a98-b8b1-3f8eb7951783 req-004482d1-1822-4fe3-8cbc-0d33dbe05aa7 service nova] Creating event network-vif-plugged:e3a00be0-39ee-4ade-8902-fe1a84c9ca37 for instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 on hv-cinder-83754 Jul 18 16:52:11.492951 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-88a6fdab-c352-4a98-b8b1-3f8eb7951783 req-004482d1-1822-4fe3-8cbc-0d33dbe05aa7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055531 Jul 18 16:52:11.494263 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 61/125] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:52:11.522133 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d66a3906-bcd9-467e-87d3-d6d0fce52a0d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:11.537784 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d66a3906-bcd9-467e-87d3-d6d0fce52a0d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.236261 Jul 18 16:52:11.538760 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 65/126] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:11 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:11.885562 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7a8ab262-74ca-4bb4-845b-35460512958a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:11.886501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7a8ab262-74ca-4bb4-845b-35460512958a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:11.896412 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7a8ab262-74ca-4bb4-845b-35460512958a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:11.897269 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7a8ab262-74ca-4bb4-845b-35460512958a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.899350 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7a8ab262-74ca-4bb4-845b-35460512958a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:11.900615 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7a8ab262-74ca-4bb4-845b-35460512958a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.124864 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2c7546fc-c1bd-4817-9cc4-e791e2474781 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:12.125647 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2c7546fc-c1bd-4817-9cc4-e791e2474781 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:12.138300 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c7546fc-c1bd-4817-9cc4-e791e2474781 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:12.138759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c7546fc-c1bd-4817-9cc4-e791e2474781 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.139549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c7546fc-c1bd-4817-9cc4-e791e2474781 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:12.139992 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c7546fc-c1bd-4817-9cc4-e791e2474781 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.161386 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7a8ab262-74ca-4bb4-845b-35460512958a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:12.182120 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7a8ab262-74ca-4bb4-845b-35460512958a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:12.184403 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7a8ab262-74ca-4bb4-845b-35460512958a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:12.188957 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7a8ab262-74ca-4bb4-845b-35460512958a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.308970 Jul 18 16:52:12.192665 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 62/127] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:11 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:52:12.367742 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2c7546fc-c1bd-4817-9cc4-e791e2474781 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:12.371592 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a70bbf6d-9508-418f-bb8d-12c0bf35e651 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:12.372847 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a70bbf6d-9508-418f-bb8d-12c0bf35e651 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:12.375890 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2c7546fc-c1bd-4817-9cc4-e791e2474781 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.257480 Jul 18 16:52:12.376691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 66/128] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:12 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:12.379726 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a70bbf6d-9508-418f-bb8d-12c0bf35e651 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:12.380183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a70bbf6d-9508-418f-bb8d-12c0bf35e651 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.380955 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a70bbf6d-9508-418f-bb8d-12c0bf35e651 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:12.381422 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a70bbf6d-9508-418f-bb8d-12c0bf35e651 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.522373 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a70bbf6d-9508-418f-bb8d-12c0bf35e651 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:12.525942 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:12.530354 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a70bbf6d-9508-418f-bb8d-12c0bf35e651 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1314 microversion: 2.1 time: 0.162593 Jul 18 16:52:12.531698 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 63/129] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:12 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:12.555660 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-713ad9c8-6949-4aa7-a8f9-d3d8718b7e4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:12.556265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-713ad9c8-6949-4aa7-a8f9-d3d8718b7e4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:12.562877 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-713ad9c8-6949-4aa7-a8f9-d3d8718b7e4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:12.563545 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-713ad9c8-6949-4aa7-a8f9-d3d8718b7e4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.564594 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-713ad9c8-6949-4aa7-a8f9-d3d8718b7e4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:12.564933 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-713ad9c8-6949-4aa7-a8f9-d3d8718b7e4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.716569 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-713ad9c8-6949-4aa7-a8f9-d3d8718b7e4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:12.725787 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-713ad9c8-6949-4aa7-a8f9-d3d8718b7e4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.173898 Jul 18 16:52:12.726366 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 67/130] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:12 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:13.208749 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4ef291f3-f4a2-460e-abcc-9842add0b361 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:13.210043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4ef291f3-f4a2-460e-abcc-9842add0b361 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:13.217412 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4ef291f3-f4a2-460e-abcc-9842add0b361 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.218425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4ef291f3-f4a2-460e-abcc-9842add0b361 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:13.219459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4ef291f3-f4a2-460e-abcc-9842add0b361 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.220050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4ef291f3-f4a2-460e-abcc-9842add0b361 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:13.369029 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4ef291f3-f4a2-460e-abcc-9842add0b361 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:13.378836 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4ef291f3-f4a2-460e-abcc-9842add0b361 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:13.380593 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4ef291f3-f4a2-460e-abcc-9842add0b361 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:13.381736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4ef291f3-f4a2-460e-abcc-9842add0b361 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.177542 Jul 18 16:52:13.382293 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 64/131] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:13 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:52:13.395790 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bbe42355-3cbf-4268-93c5-f9ab89a7b059 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:13.396512 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bbe42355-3cbf-4268-93c5-f9ab89a7b059 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:13.403325 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bbe42355-3cbf-4268-93c5-f9ab89a7b059 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.404077 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bbe42355-3cbf-4268-93c5-f9ab89a7b059 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:13.406369 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bbe42355-3cbf-4268-93c5-f9ab89a7b059 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.407084 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bbe42355-3cbf-4268-93c5-f9ab89a7b059 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:13.548394 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5ef352a0-b113-4ee2-ab1a-ffaaab556e10 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:13.549002 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5ef352a0-b113-4ee2-ab1a-ffaaab556e10 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:13.554018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-bbe42355-3cbf-4268-93c5-f9ab89a7b059 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:13.559429 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5ef352a0-b113-4ee2-ab1a-ffaaab556e10 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.560151 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5ef352a0-b113-4ee2-ab1a-ffaaab556e10 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:13.561304 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5ef352a0-b113-4ee2-ab1a-ffaaab556e10 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.561787 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bbe42355-3cbf-4268-93c5-f9ab89a7b059 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.171915 Jul 18 16:52:13.562630 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5ef352a0-b113-4ee2-ab1a-ffaaab556e10 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:13.563299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 68/132] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:13 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:13.701761 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5ef352a0-b113-4ee2-ab1a-ffaaab556e10 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:13.709651 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5ef352a0-b113-4ee2-ab1a-ffaaab556e10 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1501 microversion: 2.1 time: 0.165318 Jul 18 16:52:13.710235 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 65/133] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:13 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:13.743226 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-759e7e56-4c1f-4e6d-a65c-63730f00caca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:13.743977 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-759e7e56-4c1f-4e6d-a65c-63730f00caca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:13.750991 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-759e7e56-4c1f-4e6d-a65c-63730f00caca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.751569 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-759e7e56-4c1f-4e6d-a65c-63730f00caca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:13.752341 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-759e7e56-4c1f-4e6d-a65c-63730f00caca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.752779 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-759e7e56-4c1f-4e6d-a65c-63730f00caca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:13.903883 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-759e7e56-4c1f-4e6d-a65c-63730f00caca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:13.912953 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-759e7e56-4c1f-4e6d-a65c-63730f00caca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.173365 Jul 18 16:52:13.914024 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 69/134] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:13 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:14.400005 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2dbda4a3-8b7a-4180-bd93-ff8f33be258e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:14.400761 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2dbda4a3-8b7a-4180-bd93-ff8f33be258e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:14.407690 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2dbda4a3-8b7a-4180-bd93-ff8f33be258e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:14.408145 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2dbda4a3-8b7a-4180-bd93-ff8f33be258e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:14.409144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2dbda4a3-8b7a-4180-bd93-ff8f33be258e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:14.409543 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2dbda4a3-8b7a-4180-bd93-ff8f33be258e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:14.553462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2dbda4a3-8b7a-4180-bd93-ff8f33be258e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:14.571359 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2dbda4a3-8b7a-4180-bd93-ff8f33be258e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:14.572993 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2dbda4a3-8b7a-4180-bd93-ff8f33be258e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:14.576161 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2dbda4a3-8b7a-4180-bd93-ff8f33be258e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.178338 Jul 18 16:52:14.580576 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-259386e4-c014-404a-bc1d-b56619b26ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:14.581317 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-259386e4-c014-404a-bc1d-b56619b26ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:14.587591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-259386e4-c014-404a-bc1d-b56619b26ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:14.588402 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-259386e4-c014-404a-bc1d-b56619b26ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:14.588959 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 66/135] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:14 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:52:14.591152 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-259386e4-c014-404a-bc1d-b56619b26ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:14.592251 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-259386e4-c014-404a-bc1d-b56619b26ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:14.737858 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-259386e4-c014-404a-bc1d-b56619b26ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:14.745674 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-259386e4-c014-404a-bc1d-b56619b26ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.169979 Jul 18 16:52:14.746256 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 70/136] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:14 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:14.930085 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-db7b9994-b6d3-4127-aaff-a7971d17e71e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:14.930769 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-db7b9994-b6d3-4127-aaff-a7971d17e71e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:14.943204 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-db7b9994-b6d3-4127-aaff-a7971d17e71e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:14.943204 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-db7b9994-b6d3-4127-aaff-a7971d17e71e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:14.943204 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-db7b9994-b6d3-4127-aaff-a7971d17e71e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:14.943204 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-db7b9994-b6d3-4127-aaff-a7971d17e71e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.124356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-db7b9994-b6d3-4127-aaff-a7971d17e71e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:15.134541 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-db7b9994-b6d3-4127-aaff-a7971d17e71e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.207472 Jul 18 16:52:15.135678 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 67/137] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:14 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:15.400893 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-46fa43fd-6c56-4c6a-b244-f1bb1e069609 req-f378b290-e2c8-4c6f-bb80-59edbc9c0166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0ce676-a485-4100-8afa-a6bc5efacf8f", "name": "network-vif-plugged", "status": "completed", "tag": "829b066e-4335-4351-899c-03b885192e39"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:15.411711 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-46fa43fd-6c56-4c6a-b244-f1bb1e069609 req-f378b290-e2c8-4c6f-bb80-59edbc9c0166 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:15.412495 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-46fa43fd-6c56-4c6a-b244-f1bb1e069609 req-f378b290-e2c8-4c6f-bb80-59edbc9c0166 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.425982 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-46fa43fd-6c56-4c6a-b244-f1bb1e069609 req-f378b290-e2c8-4c6f-bb80-59edbc9c0166 service nova] Creating event network-vif-plugged:829b066e-4335-4351-899c-03b885192e39 for instance 6b0ce676-a485-4100-8afa-a6bc5efacf8f on hv-cinder-83754 Jul 18 16:52:15.431591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-46fa43fd-6c56-4c6a-b244-f1bb1e069609 req-f378b290-e2c8-4c6f-bb80-59edbc9c0166 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034219 Jul 18 16:52:15.432418 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 71/138] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:52:15.595842 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-04ea9d3e-cea8-4dd7-b446-099b3e60bdf7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:15.598195 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-04ea9d3e-cea8-4dd7-b446-099b3e60bdf7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:15.613976 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-04ea9d3e-cea8-4dd7-b446-099b3e60bdf7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:15.614730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-04ea9d3e-cea8-4dd7-b446-099b3e60bdf7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.618585 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-04ea9d3e-cea8-4dd7-b446-099b3e60bdf7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:15.619184 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-04ea9d3e-cea8-4dd7-b446-099b3e60bdf7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.767039 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ad182ab1-f742-43e9-bc40-bf027404697c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:15.767891 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ad182ab1-f742-43e9-bc40-bf027404697c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:15.798868 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad182ab1-f742-43e9-bc40-bf027404697c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:15.800342 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad182ab1-f742-43e9-bc40-bf027404697c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.801481 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad182ab1-f742-43e9-bc40-bf027404697c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:15.802244 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad182ab1-f742-43e9-bc40-bf027404697c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.805932 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-04ea9d3e-cea8-4dd7-b446-099b3e60bdf7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:15.819290 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-04ea9d3e-cea8-4dd7-b446-099b3e60bdf7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:15.820897 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-04ea9d3e-cea8-4dd7-b446-099b3e60bdf7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:15.822127 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-04ea9d3e-cea8-4dd7-b446-099b3e60bdf7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1407 microversion: 2.20 time: 0.230880 Jul 18 16:52:15.824051 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 68/139] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:15 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:52:15.985776 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ad182ab1-f742-43e9-bc40-bf027404697c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:15.995647 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ad182ab1-f742-43e9-bc40-bf027404697c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.234979 Jul 18 16:52:15.996227 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 72/140] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:15 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:16.151802 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-eb2d79af-c59a-400e-b87b-33514981f56c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:16.152444 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-eb2d79af-c59a-400e-b87b-33514981f56c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:16.159471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eb2d79af-c59a-400e-b87b-33514981f56c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:16.160192 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eb2d79af-c59a-400e-b87b-33514981f56c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:16.161420 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eb2d79af-c59a-400e-b87b-33514981f56c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:16.162184 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eb2d79af-c59a-400e-b87b-33514981f56c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:16.369124 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-eb2d79af-c59a-400e-b87b-33514981f56c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:16.376959 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-eb2d79af-c59a-400e-b87b-33514981f56c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.228938 Jul 18 16:52:16.377565 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 69/141] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:16 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:16.842076 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-00dce71a-29dc-4734-bc34-f5a75a59597b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:16.842682 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-00dce71a-29dc-4734-bc34-f5a75a59597b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:16.850299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00dce71a-29dc-4734-bc34-f5a75a59597b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:16.850938 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00dce71a-29dc-4734-bc34-f5a75a59597b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:16.851795 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00dce71a-29dc-4734-bc34-f5a75a59597b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:16.852222 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00dce71a-29dc-4734-bc34-f5a75a59597b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:16.857438 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:17.019812 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2ceb2539-c023-4fae-8181-f39e1eaa7c23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:17.020857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2ceb2539-c023-4fae-8181-f39e1eaa7c23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:17.028654 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ceb2539-c023-4fae-8181-f39e1eaa7c23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:17.029251 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ceb2539-c023-4fae-8181-f39e1eaa7c23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:17.030315 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ceb2539-c023-4fae-8181-f39e1eaa7c23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:17.031498 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ceb2539-c023-4fae-8181-f39e1eaa7c23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:17.032479 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-00dce71a-29dc-4734-bc34-f5a75a59597b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:17.050209 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-00dce71a-29dc-4734-bc34-f5a75a59597b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:17.057338 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-00dce71a-29dc-4734-bc34-f5a75a59597b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:17.059082 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-00dce71a-29dc-4734-bc34-f5a75a59597b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1600 microversion: 2.20 time: 0.221000 Jul 18 16:52:17.060159 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 73/142] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:52:16 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1600 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:52:17.080727 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ec7f5f9b-6bb5-49e3-8df9-eb6932a2c8b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:17.081501 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ec7f5f9b-6bb5-49e3-8df9-eb6932a2c8b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:17.089048 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec7f5f9b-6bb5-49e3-8df9-eb6932a2c8b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:17.090073 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec7f5f9b-6bb5-49e3-8df9-eb6932a2c8b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:17.091197 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec7f5f9b-6bb5-49e3-8df9-eb6932a2c8b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:17.091792 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec7f5f9b-6bb5-49e3-8df9-eb6932a2c8b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:17.261276 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ec7f5f9b-6bb5-49e3-8df9-eb6932a2c8b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.184679 Jul 18 16:52:17.261867 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 74/143] 10.222.0.76 () {60 vars in 1315 bytes} [Mon Jul 18 16:52:17 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-interface => generated 285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:52:17.293407 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2ceb2539-c023-4fae-8181-f39e1eaa7c23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:17.294562 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2ceb2539-c023-4fae-8181-f39e1eaa7c23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.282283 Jul 18 16:52:17.295064 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 70/144] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:17 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:17.302328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5f166f20-492a-4915-bba8-2956accbb259 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2de31309-ead9-47eb-8c44-154a0af575e8"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:17.303453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5f166f20-492a-4915-bba8-2956accbb259 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:17.310787 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f166f20-492a-4915-bba8-2956accbb259 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:17.310787 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f166f20-492a-4915-bba8-2956accbb259 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:17.311520 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f166f20-492a-4915-bba8-2956accbb259 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:17.311959 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f166f20-492a-4915-bba8-2956accbb259 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:17.403879 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-457e1911-f390-44d9-b944-3c032fe93788 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:17.403879 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-457e1911-f390-44d9-b944-3c032fe93788 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:17.421148 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-457e1911-f390-44d9-b944-3c032fe93788 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:17.422843 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-457e1911-f390-44d9-b944-3c032fe93788 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:17.427895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-457e1911-f390-44d9-b944-3c032fe93788 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:17.428564 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-457e1911-f390-44d9-b944-3c032fe93788 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:17.665505 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-457e1911-f390-44d9-b944-3c032fe93788 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:17.673822 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-457e1911-f390-44d9-b944-3c032fe93788 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.282510 Jul 18 16:52:17.683895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 71/145] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:17 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:18.312085 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b6e540cf-78fc-4878-b83d-ac800186615b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:18.313453 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b6e540cf-78fc-4878-b83d-ac800186615b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:18.320124 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b6e540cf-78fc-4878-b83d-ac800186615b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:18.320882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b6e540cf-78fc-4878-b83d-ac800186615b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:18.321739 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b6e540cf-78fc-4878-b83d-ac800186615b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:18.322194 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b6e540cf-78fc-4878-b83d-ac800186615b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:18.526409 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b6e540cf-78fc-4878-b83d-ac800186615b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:18.535216 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b6e540cf-78fc-4878-b83d-ac800186615b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.227051 Jul 18 16:52:18.535996 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 72/146] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:18 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:18.697167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-47294767-a14a-42f5-9973-24abf0d9432e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:18.697772 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-47294767-a14a-42f5-9973-24abf0d9432e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:18.708173 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-47294767-a14a-42f5-9973-24abf0d9432e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:18.708820 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-47294767-a14a-42f5-9973-24abf0d9432e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:18.709782 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-47294767-a14a-42f5-9973-24abf0d9432e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:18.710506 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-47294767-a14a-42f5-9973-24abf0d9432e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:18.903261 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-47294767-a14a-42f5-9973-24abf0d9432e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:18.914036 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-47294767-a14a-42f5-9973-24abf0d9432e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.226585 Jul 18 16:52:18.925629 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 73/147] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:18 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:19.079667 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-0ac47d43-9f73-4ea1-9be4-95096594f740 req-1e0a9b12-d25d-4ac8-8731-48bbb1bc440d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d31815-4f8c-4e76-adcb-8039b88488d0", "tag": "cbb20d80-19a9-48b1-be96-866c4a0904d4"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:19.088395 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-0ac47d43-9f73-4ea1-9be4-95096594f740 req-1e0a9b12-d25d-4ac8-8731-48bbb1bc440d service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:19.088817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-0ac47d43-9f73-4ea1-9be4-95096594f740 req-1e0a9b12-d25d-4ac8-8731-48bbb1bc440d service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:19.102866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-0ac47d43-9f73-4ea1-9be4-95096594f740 req-1e0a9b12-d25d-4ac8-8731-48bbb1bc440d service nova] Creating event network-changed:cbb20d80-19a9-48b1-be96-866c4a0904d4 for instance c3d31815-4f8c-4e76-adcb-8039b88488d0 on hv-cinder-83754 Jul 18 16:52:19.108387 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-0ac47d43-9f73-4ea1-9be4-95096594f740 req-1e0a9b12-d25d-4ac8-8731-48bbb1bc440d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033515 Jul 18 16:52:19.116618 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 74/148] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:52:19.554609 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d27d7e84-981a-472b-9b99-4fbf8a5685f4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:19.556076 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d27d7e84-981a-472b-9b99-4fbf8a5685f4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:19.562981 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d27d7e84-981a-472b-9b99-4fbf8a5685f4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:19.563899 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d27d7e84-981a-472b-9b99-4fbf8a5685f4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:19.564694 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d27d7e84-981a-472b-9b99-4fbf8a5685f4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:19.565163 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d27d7e84-981a-472b-9b99-4fbf8a5685f4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:19.758547 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d27d7e84-981a-472b-9b99-4fbf8a5685f4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:19.767033 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d27d7e84-981a-472b-9b99-4fbf8a5685f4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.216963 Jul 18 16:52:19.767619 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 75/149] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:19 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:19.931410 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4811f6ed-e8a8-4e0d-9f1c-666ee3b8db98 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:19.932016 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4811f6ed-e8a8-4e0d-9f1c-666ee3b8db98 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:19.940202 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4811f6ed-e8a8-4e0d-9f1c-666ee3b8db98 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:19.940666 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4811f6ed-e8a8-4e0d-9f1c-666ee3b8db98 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:19.941585 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4811f6ed-e8a8-4e0d-9f1c-666ee3b8db98 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:19.942190 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4811f6ed-e8a8-4e0d-9f1c-666ee3b8db98 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:20.152245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4811f6ed-e8a8-4e0d-9f1c-666ee3b8db98 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:20.161894 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4811f6ed-e8a8-4e0d-9f1c-666ee3b8db98 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1322 microversion: 2.1 time: 0.233846 Jul 18 16:52:20.165629 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 76/150] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:19 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:20.784265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9aeffcc1-7235-4e40-bef7-f1083cf0668b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:20.784846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9aeffcc1-7235-4e40-bef7-f1083cf0668b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:20.791105 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9aeffcc1-7235-4e40-bef7-f1083cf0668b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:20.791559 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9aeffcc1-7235-4e40-bef7-f1083cf0668b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:20.792462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9aeffcc1-7235-4e40-bef7-f1083cf0668b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:20.792904 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9aeffcc1-7235-4e40-bef7-f1083cf0668b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:20.940255 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9aeffcc1-7235-4e40-bef7-f1083cf0668b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:20.950381 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9aeffcc1-7235-4e40-bef7-f1083cf0668b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.170553 Jul 18 16:52:20.951237 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 77/151] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:20 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:21.182046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9d5e4757-ef74-4e7b-b216-044d01501d28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:21.182878 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9d5e4757-ef74-4e7b-b216-044d01501d28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:21.197181 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d5e4757-ef74-4e7b-b216-044d01501d28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:21.201440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d5e4757-ef74-4e7b-b216-044d01501d28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:21.203943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d5e4757-ef74-4e7b-b216-044d01501d28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:21.204975 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d5e4757-ef74-4e7b-b216-044d01501d28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:21.444799 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9d5e4757-ef74-4e7b-b216-044d01501d28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:21.454477 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9d5e4757-ef74-4e7b-b216-044d01501d28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1517 microversion: 2.1 time: 0.276488 Jul 18 16:52:21.456420 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 78/152] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:21 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1517 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:21.481795 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cb4d62ae-1b1c-49fb-93d1-08b2fc4ca40c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:21.481795 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cb4d62ae-1b1c-49fb-93d1-08b2fc4ca40c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:21.494277 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cb4d62ae-1b1c-49fb-93d1-08b2fc4ca40c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:21.496263 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cb4d62ae-1b1c-49fb-93d1-08b2fc4ca40c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:21.497506 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cb4d62ae-1b1c-49fb-93d1-08b2fc4ca40c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:21.498155 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cb4d62ae-1b1c-49fb-93d1-08b2fc4ca40c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:21.601378 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-cb4d62ae-1b1c-49fb-93d1-08b2fc4ca40c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lazy-loading 'flavor' on Instance uuid 6b0ce676-a485-4100-8afa-a6bc5efacf8f {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:52:21.834617 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:21.978987 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5f166f20-492a-4915-bba8-2956accbb259 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "POST /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.678357 Jul 18 16:52:21.978987 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 75/153] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 16:52:17 2022] POST /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265/os-volume_attachments => generated 194 bytes in 4680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:52:21.979838 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0ba26dfb-8f13-4ac7-a212-cb46864f5b0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:21.986180 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0ba26dfb-8f13-4ac7-a212-cb46864f5b0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:22.002152 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0ba26dfb-8f13-4ac7-a212-cb46864f5b0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:22.003405 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0ba26dfb-8f13-4ac7-a212-cb46864f5b0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:22.004597 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0ba26dfb-8f13-4ac7-a212-cb46864f5b0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:22.005209 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0ba26dfb-8f13-4ac7-a212-cb46864f5b0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:22.167683 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0ba26dfb-8f13-4ac7-a212-cb46864f5b0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:22.167683 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0ba26dfb-8f13-4ac7-a212-cb46864f5b0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.191432 Jul 18 16:52:22.169178 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 76/154] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:21 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:22.204395 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cb4d62ae-1b1c-49fb-93d1-08b2fc4ca40c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "POST /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f/action" status: 200 len: 32 microversion: 2.1 time: 0.734395 Jul 18 16:52:22.207561 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 79/155] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 16:52:21 2022] POST /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f/action => generated 32 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:52:22.215732 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ac7c3a0f-f77a-4b0c-9c6f-09ba1fd33067 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:22.216373 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ac7c3a0f-f77a-4b0c-9c6f-09ba1fd33067 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:22.222571 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac7c3a0f-f77a-4b0c-9c6f-09ba1fd33067 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:22.223021 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac7c3a0f-f77a-4b0c-9c6f-09ba1fd33067 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:22.223783 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac7c3a0f-f77a-4b0c-9c6f-09ba1fd33067 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:22.224218 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac7c3a0f-f77a-4b0c-9c6f-09ba1fd33067 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:22.379980 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ac7c3a0f-f77a-4b0c-9c6f-09ba1fd33067 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:22.394252 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ac7c3a0f-f77a-4b0c-9c6f-09ba1fd33067 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.182398 Jul 18 16:52:22.395327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 77/156] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:22 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:23.184710 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-80146842-ee8f-47e0-8a22-69481a8b6630 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:23.186484 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-80146842-ee8f-47e0-8a22-69481a8b6630 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:23.191116 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:23.195706 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-80146842-ee8f-47e0-8a22-69481a8b6630 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:23.196194 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-80146842-ee8f-47e0-8a22-69481a8b6630 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:23.199018 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-80146842-ee8f-47e0-8a22-69481a8b6630 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:23.199018 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-80146842-ee8f-47e0-8a22-69481a8b6630 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:23.336626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-80146842-ee8f-47e0-8a22-69481a8b6630 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:23.345707 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-80146842-ee8f-47e0-8a22-69481a8b6630 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.165499 Jul 18 16:52:23.347388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 80/157] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:23 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:23.411888 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6f7400bc-102c-415c-b252-33f1a047d29b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:23.412783 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6f7400bc-102c-415c-b252-33f1a047d29b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:23.419655 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f7400bc-102c-415c-b252-33f1a047d29b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:23.425266 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f7400bc-102c-415c-b252-33f1a047d29b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:23.425266 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f7400bc-102c-415c-b252-33f1a047d29b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:23.425266 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f7400bc-102c-415c-b252-33f1a047d29b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:23.591397 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6f7400bc-102c-415c-b252-33f1a047d29b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:23.600037 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6f7400bc-102c-415c-b252-33f1a047d29b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.192074 Jul 18 16:52:23.600617 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 78/158] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:23 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:24.363859 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a0dd2422-3f11-4b3b-83f5-c10c146fbb53 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:24.364507 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a0dd2422-3f11-4b3b-83f5-c10c146fbb53 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:24.370631 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a0dd2422-3f11-4b3b-83f5-c10c146fbb53 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:24.371084 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a0dd2422-3f11-4b3b-83f5-c10c146fbb53 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:24.371855 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a0dd2422-3f11-4b3b-83f5-c10c146fbb53 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:24.372295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a0dd2422-3f11-4b3b-83f5-c10c146fbb53 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:24.514147 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a0dd2422-3f11-4b3b-83f5-c10c146fbb53 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:24.522169 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a0dd2422-3f11-4b3b-83f5-c10c146fbb53 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.162333 Jul 18 16:52:24.522738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 81/159] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:24 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:24.620823 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-110dd808-1b27-4e57-b5bf-75f4a42f0981 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:24.621495 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-110dd808-1b27-4e57-b5bf-75f4a42f0981 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:24.628585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-110dd808-1b27-4e57-b5bf-75f4a42f0981 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:24.629038 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-110dd808-1b27-4e57-b5bf-75f4a42f0981 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:24.629832 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-110dd808-1b27-4e57-b5bf-75f4a42f0981 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:24.630286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-110dd808-1b27-4e57-b5bf-75f4a42f0981 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:24.778954 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-110dd808-1b27-4e57-b5bf-75f4a42f0981 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:24.787589 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-110dd808-1b27-4e57-b5bf-75f4a42f0981 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.170478 Jul 18 16:52:24.788598 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 79/160] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:24 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:25.548303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-d0da393d-9d80-4aae-a7a2-eab1df1a9aee req-a18174ca-1cce-4b28-86a8-003e28b2696e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57c0d06-7394-47d2-ab8b-2445e996c9bd", "name": "network-vif-plugged", "status": "completed", "tag": "d7caf253-581a-4f92-93cf-cb4bd4b4b2a3"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:25.550840 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6a27bd26-3e97-4074-a139-b3f28ed398bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:25.551618 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6a27bd26-3e97-4074-a139-b3f28ed398bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:25.558428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-d0da393d-9d80-4aae-a7a2-eab1df1a9aee req-a18174ca-1cce-4b28-86a8-003e28b2696e service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:25.558877 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-d0da393d-9d80-4aae-a7a2-eab1df1a9aee req-a18174ca-1cce-4b28-86a8-003e28b2696e service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:25.562527 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6a27bd26-3e97-4074-a139-b3f28ed398bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:25.563019 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6a27bd26-3e97-4074-a139-b3f28ed398bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:25.563828 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6a27bd26-3e97-4074-a139-b3f28ed398bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:25.564440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6a27bd26-3e97-4074-a139-b3f28ed398bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:25.571487 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-d0da393d-9d80-4aae-a7a2-eab1df1a9aee req-a18174ca-1cce-4b28-86a8-003e28b2696e service nova] Creating event network-vif-plugged:d7caf253-581a-4f92-93cf-cb4bd4b4b2a3 for instance b57c0d06-7394-47d2-ab8b-2445e996c9bd on hv-cinder-83754 Jul 18 16:52:25.577448 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-d0da393d-9d80-4aae-a7a2-eab1df1a9aee req-a18174ca-1cce-4b28-86a8-003e28b2696e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033470 Jul 18 16:52:25.578759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 80/161] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:52:25.729153 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6a27bd26-3e97-4074-a139-b3f28ed398bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:25.750983 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6a27bd26-3e97-4074-a139-b3f28ed398bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.214163 Jul 18 16:52:25.761816 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 82/162] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:25 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:25.806608 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-72b6e41e-4313-4c25-8b36-db24faff2ccb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:25.808613 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-72b6e41e-4313-4c25-8b36-db24faff2ccb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:25.815206 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72b6e41e-4313-4c25-8b36-db24faff2ccb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:25.815758 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72b6e41e-4313-4c25-8b36-db24faff2ccb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:25.816604 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72b6e41e-4313-4c25-8b36-db24faff2ccb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:25.817144 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72b6e41e-4313-4c25-8b36-db24faff2ccb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:25.963369 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-72b6e41e-4313-4c25-8b36-db24faff2ccb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:25.979366 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-72b6e41e-4313-4c25-8b36-db24faff2ccb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.177349 Jul 18 16:52:25.980474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 81/163] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:25 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:26.776868 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0dac64a7-64d7-4a8c-94f1-79b20bb91b6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:26.777514 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0dac64a7-64d7-4a8c-94f1-79b20bb91b6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:26.784927 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0dac64a7-64d7-4a8c-94f1-79b20bb91b6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:26.785479 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0dac64a7-64d7-4a8c-94f1-79b20bb91b6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:26.786253 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0dac64a7-64d7-4a8c-94f1-79b20bb91b6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:26.786718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0dac64a7-64d7-4a8c-94f1-79b20bb91b6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:26.946438 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0dac64a7-64d7-4a8c-94f1-79b20bb91b6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:26.959564 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0dac64a7-64d7-4a8c-94f1-79b20bb91b6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.186191 Jul 18 16:52:26.960624 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 83/164] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:26 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:27.004700 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4351702d-8fd8-4abb-9af8-3ae9a77f7d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:27.005355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4351702d-8fd8-4abb-9af8-3ae9a77f7d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:27.012341 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4351702d-8fd8-4abb-9af8-3ae9a77f7d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:27.012797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4351702d-8fd8-4abb-9af8-3ae9a77f7d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:27.013671 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4351702d-8fd8-4abb-9af8-3ae9a77f7d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:27.014113 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4351702d-8fd8-4abb-9af8-3ae9a77f7d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:27.161100 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4351702d-8fd8-4abb-9af8-3ae9a77f7d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:27.168920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4351702d-8fd8-4abb-9af8-3ae9a77f7d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.168204 Jul 18 16:52:27.169730 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 82/165] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:26 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:27.987133 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-44134676-3391-4f15-b568-1fe6e570cbf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:27.987740 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-44134676-3391-4f15-b568-1fe6e570cbf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:27.994641 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-44134676-3391-4f15-b568-1fe6e570cbf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:27.995192 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-44134676-3391-4f15-b568-1fe6e570cbf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:27.996203 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-44134676-3391-4f15-b568-1fe6e570cbf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:27.996810 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-44134676-3391-4f15-b568-1fe6e570cbf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:28.149454 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-44134676-3391-4f15-b568-1fe6e570cbf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:28.164341 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-44134676-3391-4f15-b568-1fe6e570cbf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1366 microversion: 2.1 time: 0.181006 Jul 18 16:52:28.165641 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 84/166] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:27 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:28.186284 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9c329300-df10-4cc8-b263-aceaa3dddfd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:28.187831 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9c329300-df10-4cc8-b263-aceaa3dddfd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:28.194932 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c329300-df10-4cc8-b263-aceaa3dddfd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:28.195606 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c329300-df10-4cc8-b263-aceaa3dddfd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:28.197084 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c329300-df10-4cc8-b263-aceaa3dddfd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:28.203635 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c329300-df10-4cc8-b263-aceaa3dddfd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:28.367334 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9c329300-df10-4cc8-b263-aceaa3dddfd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:28.377494 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9c329300-df10-4cc8-b263-aceaa3dddfd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.194881 Jul 18 16:52:28.378000 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 83/167] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:28 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:29.182404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1f35fb74-f692-4633-8fcf-25665557cc2d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:29.183579 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1f35fb74-f692-4633-8fcf-25665557cc2d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:29.190564 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1f35fb74-f692-4633-8fcf-25665557cc2d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:29.191301 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1f35fb74-f692-4633-8fcf-25665557cc2d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:29.192272 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1f35fb74-f692-4633-8fcf-25665557cc2d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:29.192840 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1f35fb74-f692-4633-8fcf-25665557cc2d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:29.343652 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1f35fb74-f692-4633-8fcf-25665557cc2d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:29.352248 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1f35fb74-f692-4633-8fcf-25665557cc2d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1556 microversion: 2.1 time: 0.173821 Jul 18 16:52:29.359786 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 85/168] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:29 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:29.371146 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f0171fb8-9c24-43a1-a8eb-6cfcea7c16ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:29.371692 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f0171fb8-9c24-43a1-a8eb-6cfcea7c16ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:29.379144 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f0171fb8-9c24-43a1-a8eb-6cfcea7c16ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:29.379649 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f0171fb8-9c24-43a1-a8eb-6cfcea7c16ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:29.380356 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f0171fb8-9c24-43a1-a8eb-6cfcea7c16ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:29.380797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f0171fb8-9c24-43a1-a8eb-6cfcea7c16ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:29.396607 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a2955cc4-a465-4a90-80ac-2e1b464367bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:29.397251 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a2955cc4-a465-4a90-80ac-2e1b464367bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:29.403653 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a2955cc4-a465-4a90-80ac-2e1b464367bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:29.405651 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a2955cc4-a465-4a90-80ac-2e1b464367bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:29.405651 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a2955cc4-a465-4a90-80ac-2e1b464367bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:29.405651 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a2955cc4-a465-4a90-80ac-2e1b464367bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:29.471271 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f0171fb8-9c24-43a1-a8eb-6cfcea7c16ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103567 Jul 18 16:52:29.471271 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 84/169] 10.222.0.76 () {58 vars in 1274 bytes} [Mon Jul 18 16:52:29 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:52:29.557852 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a2955cc4-a465-4a90-80ac-2e1b464367bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:29.566459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a2955cc4-a465-4a90-80ac-2e1b464367bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.173637 Jul 18 16:52:29.567293 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 86/170] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:29 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:30.588602 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-563ca6f8-9933-4416-97e4-fdd716a6944e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:30.589250 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-563ca6f8-9933-4416-97e4-fdd716a6944e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:30.596150 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-563ca6f8-9933-4416-97e4-fdd716a6944e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:30.596734 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-563ca6f8-9933-4416-97e4-fdd716a6944e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:30.597412 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-563ca6f8-9933-4416-97e4-fdd716a6944e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:30.597845 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-563ca6f8-9933-4416-97e4-fdd716a6944e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:30.849933 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-563ca6f8-9933-4416-97e4-fdd716a6944e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:30.859448 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-563ca6f8-9933-4416-97e4-fdd716a6944e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.275339 Jul 18 16:52:30.860539 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 85/171] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:30 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:30.903941 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-bb025737-dbcb-460c-8304-487ba4b2e7e6 req-c939bb71-9b34-4589-a093-9aedab4fb026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57c0d06-7394-47d2-ab8b-2445e996c9bd", "tag": "d7caf253-581a-4f92-93cf-cb4bd4b4b2a3"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:30.913580 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-bb025737-dbcb-460c-8304-487ba4b2e7e6 req-c939bb71-9b34-4589-a093-9aedab4fb026 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:30.914136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-bb025737-dbcb-460c-8304-487ba4b2e7e6 req-c939bb71-9b34-4589-a093-9aedab4fb026 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:30.929472 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-bb025737-dbcb-460c-8304-487ba4b2e7e6 req-c939bb71-9b34-4589-a093-9aedab4fb026 service nova] Creating event network-changed:d7caf253-581a-4f92-93cf-cb4bd4b4b2a3 for instance b57c0d06-7394-47d2-ab8b-2445e996c9bd on hv-cinder-83754 Jul 18 16:52:30.935401 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-bb025737-dbcb-460c-8304-487ba4b2e7e6 req-c939bb71-9b34-4589-a093-9aedab4fb026 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035606 Jul 18 16:52:30.936110 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 87/172] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:52:31.877993 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4fd191a4-6227-4120-a48c-ce7dd4cd364f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:31.879208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4fd191a4-6227-4120-a48c-ce7dd4cd364f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:31.886160 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4fd191a4-6227-4120-a48c-ce7dd4cd364f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:31.886612 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4fd191a4-6227-4120-a48c-ce7dd4cd364f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:31.887396 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4fd191a4-6227-4120-a48c-ce7dd4cd364f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:31.887861 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4fd191a4-6227-4120-a48c-ce7dd4cd364f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:32.539586 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4fd191a4-6227-4120-a48c-ce7dd4cd364f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:32.551187 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4fd191a4-6227-4120-a48c-ce7dd4cd364f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.677389 Jul 18 16:52:32.552018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 86/173] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:31 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:33.569394 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2ab85cee-76fb-471f-8fd6-3f309417389f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:33.570100 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2ab85cee-76fb-471f-8fd6-3f309417389f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:33.576950 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ab85cee-76fb-471f-8fd6-3f309417389f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:33.577768 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ab85cee-76fb-471f-8fd6-3f309417389f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:33.578755 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ab85cee-76fb-471f-8fd6-3f309417389f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:33.579355 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ab85cee-76fb-471f-8fd6-3f309417389f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:33.791452 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2ab85cee-76fb-471f-8fd6-3f309417389f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:33.800735 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2ab85cee-76fb-471f-8fd6-3f309417389f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.235758 Jul 18 16:52:33.802803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 88/174] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:33 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:34.344643 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-69c420f2-03ac-4ff2-87b7-259682fff2be tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:34.345463 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-69c420f2-03ac-4ff2-87b7-259682fff2be tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:34.352195 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-69c420f2-03ac-4ff2-87b7-259682fff2be tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:34.352650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-69c420f2-03ac-4ff2-87b7-259682fff2be tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:34.357503 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-69c420f2-03ac-4ff2-87b7-259682fff2be tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:34.357503 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-69c420f2-03ac-4ff2-87b7-259682fff2be tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:34.403303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-69c420f2-03ac-4ff2-87b7-259682fff2be tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:52:34.784863 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-69c420f2-03ac-4ff2-87b7-259682fff2be tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 204 len: 0 microversion: 2.1 time: 0.443711 Jul 18 16:52:34.788694 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 87/175] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 16:52:34 2022] DELETE /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:52:34.797263 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3d3e57fb-baa1-406d-a2d4-64a5030180b6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:34.797263 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3d3e57fb-baa1-406d-a2d4-64a5030180b6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:34.802060 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d3e57fb-baa1-406d-a2d4-64a5030180b6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:34.802517 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d3e57fb-baa1-406d-a2d4-64a5030180b6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:34.803286 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d3e57fb-baa1-406d-a2d4-64a5030180b6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:34.803719 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d3e57fb-baa1-406d-a2d4-64a5030180b6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:34.820954 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1195e224-ffd7-4f8d-9f38-ff17199725c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:34.821807 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1195e224-ffd7-4f8d-9f38-ff17199725c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:34.833968 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1195e224-ffd7-4f8d-9f38-ff17199725c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:34.835552 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1195e224-ffd7-4f8d-9f38-ff17199725c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:34.836619 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1195e224-ffd7-4f8d-9f38-ff17199725c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:34.837130 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1195e224-ffd7-4f8d-9f38-ff17199725c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:34.843093 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:34.971592 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3d3e57fb-baa1-406d-a2d4-64a5030180b6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:34.980636 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3d3e57fb-baa1-406d-a2d4-64a5030180b6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1553 microversion: 2.1 time: 0.189584 Jul 18 16:52:34.981767 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 89/176] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:34 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:35.007565 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1195e224-ffd7-4f8d-9f38-ff17199725c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:35.014977 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1195e224-ffd7-4f8d-9f38-ff17199725c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.199631 Jul 18 16:52:35.015793 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 88/177] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:34 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:36.001397 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c68ccd5f-7b51-4291-a123-6c5b0c87e8e9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:36.002578 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c68ccd5f-7b51-4291-a123-6c5b0c87e8e9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:36.029073 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c68ccd5f-7b51-4291-a123-6c5b0c87e8e9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:36.029828 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c68ccd5f-7b51-4291-a123-6c5b0c87e8e9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:36.030657 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c68ccd5f-7b51-4291-a123-6c5b0c87e8e9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:36.031225 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c68ccd5f-7b51-4291-a123-6c5b0c87e8e9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:36.042028 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a91f6ce9-adb0-4918-b5e9-d03a53ed6336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:36.042750 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a91f6ce9-adb0-4918-b5e9-d03a53ed6336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:36.054860 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a91f6ce9-adb0-4918-b5e9-d03a53ed6336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:36.055197 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a91f6ce9-adb0-4918-b5e9-d03a53ed6336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:36.056295 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a91f6ce9-adb0-4918-b5e9-d03a53ed6336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:36.056890 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a91f6ce9-adb0-4918-b5e9-d03a53ed6336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:36.211156 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a91f6ce9-adb0-4918-b5e9-d03a53ed6336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:36.220508 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a91f6ce9-adb0-4918-b5e9-d03a53ed6336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.191764 Jul 18 16:52:36.221287 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 89/178] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:36 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:36.254976 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c68ccd5f-7b51-4291-a123-6c5b0c87e8e9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:36.263307 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c68ccd5f-7b51-4291-a123-6c5b0c87e8e9 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1553 microversion: 2.1 time: 0.266230 Jul 18 16:52:36.264202 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 90/179] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:35 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1553 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:37.239807 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-54e30577-acdb-41e5-9c63-12f046830c22 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:37.240437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-54e30577-acdb-41e5-9c63-12f046830c22 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:37.247422 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54e30577-acdb-41e5-9c63-12f046830c22 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:37.247867 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54e30577-acdb-41e5-9c63-12f046830c22 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:37.248642 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54e30577-acdb-41e5-9c63-12f046830c22 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:37.249295 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54e30577-acdb-41e5-9c63-12f046830c22 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:37.282459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-66f5d8e6-3dbf-4692-ad45-9cec361edad5 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:37.283464 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-66f5d8e6-3dbf-4692-ad45-9cec361edad5 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:37.290879 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-66f5d8e6-3dbf-4692-ad45-9cec361edad5 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:37.291334 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-66f5d8e6-3dbf-4692-ad45-9cec361edad5 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:37.292111 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-66f5d8e6-3dbf-4692-ad45-9cec361edad5 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:37.292555 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-66f5d8e6-3dbf-4692-ad45-9cec361edad5 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:37.416086 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-54e30577-acdb-41e5-9c63-12f046830c22 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:37.426002 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-54e30577-acdb-41e5-9c63-12f046830c22 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.190310 Jul 18 16:52:37.426811 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 90/180] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:37 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:37.475446 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-66f5d8e6-3dbf-4692-ad45-9cec361edad5 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:37.482703 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-66f5d8e6-3dbf-4692-ad45-9cec361edad5 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1553 microversion: 2.1 time: 0.205355 Jul 18 16:52:37.483266 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 91/181] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:37 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:38.444825 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5ca5a1b5-7738-40a7-ab5a-00d3a6649344 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:38.445520 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5ca5a1b5-7738-40a7-ab5a-00d3a6649344 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:38.466103 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ca5a1b5-7738-40a7-ab5a-00d3a6649344 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:38.466558 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ca5a1b5-7738-40a7-ab5a-00d3a6649344 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:38.467023 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-6f3f07d3-1ba9-4fcf-b389-4d5a0e10da04 req-01e9efb3-d693-4887-ab3c-f0f79bbbaecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dd8e166-14c8-46d5-80a3-a70d57745265", "name": "network-vif-deleted", "tag": "11b787d6-ea05-4fdd-affb-4ab3787f16ab"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:38.467479 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ca5a1b5-7738-40a7-ab5a-00d3a6649344 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:38.467758 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ca5a1b5-7738-40a7-ab5a-00d3a6649344 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:38.483205 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-6f3f07d3-1ba9-4fcf-b389-4d5a0e10da04 req-01e9efb3-d693-4887-ab3c-f0f79bbbaecc service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:38.486744 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-6f3f07d3-1ba9-4fcf-b389-4d5a0e10da04 req-01e9efb3-d693-4887-ab3c-f0f79bbbaecc service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:38.528325 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-6f3f07d3-1ba9-4fcf-b389-4d5a0e10da04 req-01e9efb3-d693-4887-ab3c-f0f79bbbaecc service nova] Creating event network-vif-deleted:11b787d6-ea05-4fdd-affb-4ab3787f16ab for instance 4dd8e166-14c8-46d5-80a3-a70d57745265 on hv-cinder-83754 Jul 18 16:52:38.540718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-6f3f07d3-1ba9-4fcf-b389-4d5a0e10da04 req-01e9efb3-d693-4887-ab3c-f0f79bbbaecc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075721 Jul 18 16:52:38.542667 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 92/182] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:52:38.557892 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-665c8862-b164-473b-9450-35747a0dc6c6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:38.561323 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-665c8862-b164-473b-9450-35747a0dc6c6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:38.581293 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-665c8862-b164-473b-9450-35747a0dc6c6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:38.587046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-665c8862-b164-473b-9450-35747a0dc6c6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:38.587046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-665c8862-b164-473b-9450-35747a0dc6c6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:38.587046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-665c8862-b164-473b-9450-35747a0dc6c6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:38.646299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5ca5a1b5-7738-40a7-ab5a-00d3a6649344 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:38.655249 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5ca5a1b5-7738-40a7-ab5a-00d3a6649344 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.214581 Jul 18 16:52:38.656300 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 91/183] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:38 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:38.681055 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-665c8862-b164-473b-9450-35747a0dc6c6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:38.689115 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-665c8862-b164-473b-9450-35747a0dc6c6 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1511 microversion: 2.1 time: 0.145053 Jul 18 16:52:38.689611 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 93/184] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:38 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1511 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:39.673894 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f500ff49-21bf-4382-b9fc-e2c7b9e50c6a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:39.673894 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f500ff49-21bf-4382-b9fc-e2c7b9e50c6a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:39.682443 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f500ff49-21bf-4382-b9fc-e2c7b9e50c6a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:39.683094 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f500ff49-21bf-4382-b9fc-e2c7b9e50c6a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:39.684180 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f500ff49-21bf-4382-b9fc-e2c7b9e50c6a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:39.684863 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f500ff49-21bf-4382-b9fc-e2c7b9e50c6a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:39.708195 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a1f80e08-5593-40f9-9d07-f6936dbc2913 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:39.708870 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a1f80e08-5593-40f9-9d07-f6936dbc2913 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:39.718421 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a1f80e08-5593-40f9-9d07-f6936dbc2913 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:39.722968 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a1f80e08-5593-40f9-9d07-f6936dbc2913 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:39.724006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a1f80e08-5593-40f9-9d07-f6936dbc2913 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:39.724532 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a1f80e08-5593-40f9-9d07-f6936dbc2913 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:39.818378 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a1f80e08-5593-40f9-9d07-f6936dbc2913 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:39.828582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a1f80e08-5593-40f9-9d07-f6936dbc2913 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1345 microversion: 2.1 time: 0.125014 Jul 18 16:52:39.833141 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 94/185] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:39 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:39.848500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f500ff49-21bf-4382-b9fc-e2c7b9e50c6a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:39.856522 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f500ff49-21bf-4382-b9fc-e2c7b9e50c6a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.188024 Jul 18 16:52:39.857385 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 92/186] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:39 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:40.849889 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-29acbc34-255c-4afa-8268-3bdcf67ac0c2 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:40.850990 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-29acbc34-255c-4afa-8268-3bdcf67ac0c2 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:40.871851 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29acbc34-255c-4afa-8268-3bdcf67ac0c2 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:40.871851 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29acbc34-255c-4afa-8268-3bdcf67ac0c2 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:40.871851 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29acbc34-255c-4afa-8268-3bdcf67ac0c2 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:40.871851 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29acbc34-255c-4afa-8268-3bdcf67ac0c2 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:40.875117 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-48e3f6ab-90d6-470f-84db-13935cafa728 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:40.876030 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-48e3f6ab-90d6-470f-84db-13935cafa728 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:40.883889 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-48e3f6ab-90d6-470f-84db-13935cafa728 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:40.884546 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-48e3f6ab-90d6-470f-84db-13935cafa728 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:40.885658 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-48e3f6ab-90d6-470f-84db-13935cafa728 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:40.886097 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-48e3f6ab-90d6-470f-84db-13935cafa728 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:40.942071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29acbc34-255c-4afa-8268-3bdcf67ac0c2 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:40.942855 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29acbc34-255c-4afa-8268-3bdcf67ac0c2 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:40.943573 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-29acbc34-255c-4afa-8268-3bdcf67ac0c2 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lazy-loading 'fault' on Instance uuid 4dd8e166-14c8-46d5-80a3-a70d57745265 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:52:41.011409 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-29acbc34-255c-4afa-8268-3bdcf67ac0c2 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6df4c3768134ebeb90d5566624a7cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d7c6ee418c41cb833e47c51ea4158b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:41.019959 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-29acbc34-255c-4afa-8268-3bdcf67ac0c2 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 200 len: 1304 microversion: 2.1 time: 0.177557 Jul 18 16:52:41.022312 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 95/187] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:40 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 1304 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:41.085346 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-48e3f6ab-90d6-470f-84db-13935cafa728 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:41.092961 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-48e3f6ab-90d6-470f-84db-13935cafa728 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.223873 Jul 18 16:52:41.093687 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 93/188] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:40 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:42.044529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-224966a0-6f8a-4ad3-a81b-19c6c2705b6a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:42.045337 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-224966a0-6f8a-4ad3-a81b-19c6c2705b6a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:42.053804 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-224966a0-6f8a-4ad3-a81b-19c6c2705b6a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.054278 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-224966a0-6f8a-4ad3-a81b-19c6c2705b6a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.055760 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-224966a0-6f8a-4ad3-a81b-19c6c2705b6a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.056248 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-224966a0-6f8a-4ad3-a81b-19c6c2705b6a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.072924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-224966a0-6f8a-4ad3-a81b-19c6c2705b6a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] HTTP exception thrown: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-224966a0-6f8a-4ad3-a81b-19c6c2705b6a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Request method failure captured: Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 HTTP/1.1 Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-FI_z-0atxYJzblmwGocPvwLdHFlX4aQSRItWUa5ZEO-zurzc8ZIxJz7GYN67xqxRbXZ8HGgHjUBey9zRAAUnKIf5Eik9Z2rL97yfkQojXZqsQjUg40NtYHToKa0agKTIhadXp9gkDvO-M1VwePBlPamV_OBkeiNC2beKhdvQT4RQ Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: b5d7c6ee418c41cb833e47c51ea4158b Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-DeleteServersTestJSON-284087079 Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 16:52:42.078351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 16:52:42.079966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:52:42.079966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-DeleteServersTestJSON-284087079 Jul 18 16:52:42.079966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: b5d7c6ee418c41cb833e47c51ea4158b Jul 18 16:52:42.079966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-DeleteServersTestJSON-284087079 Jul 18 16:52:42.079966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-DeleteServersTestJSON-284087079-project Jul 18 16:52:42.079966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 16:52:42.079966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 16:52:42.079966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: d6df4c3768134ebeb90d5566624a7cdd Jul 18 16:52:42.079966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-DeleteServersTestJSON-284087079-project Jul 18 16:52:42.079966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 16:52:42.079966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:42.079966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '4dd8e166-14c8-46d5-80a3-a70d57745265'} Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:52:42.080693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:42.081817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:42.082778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-224966a0-6f8a-4ad3-a81b-19c6c2705b6a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Returning 404 to user: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:52:42.082778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-224966a0-6f8a-4ad3-a81b-19c6c2705b6a tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 404 len: 111 microversion: 2.1 time: 0.040055 Jul 18 16:52:42.082778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 96/189] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:42 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:52:42.111826 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0456a1e3-b47f-4fa3-aa1b-e51e67470031 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:42.112414 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0456a1e3-b47f-4fa3-aa1b-e51e67470031 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:42.134102 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0456a1e3-b47f-4fa3-aa1b-e51e67470031 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.135964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0456a1e3-b47f-4fa3-aa1b-e51e67470031 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.136802 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0456a1e3-b47f-4fa3-aa1b-e51e67470031 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.137278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0456a1e3-b47f-4fa3-aa1b-e51e67470031 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.272337 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-defd7e9e-dea3-470e-a3ee-882448c36814 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:42.273377 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-defd7e9e-dea3-470e-a3ee-882448c36814 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:42.279902 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-defd7e9e-dea3-470e-a3ee-882448c36814 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.280638 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-defd7e9e-dea3-470e-a3ee-882448c36814 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.282116 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-defd7e9e-dea3-470e-a3ee-882448c36814 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.282900 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-defd7e9e-dea3-470e-a3ee-882448c36814 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.301094 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-defd7e9e-dea3-470e-a3ee-882448c36814 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] HTTP exception thrown: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-defd7e9e-dea3-470e-a3ee-882448c36814 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Request method failure captured: Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265/os-volume_attachments HTTP/1.1 Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-FI_z-0atxYJzblmwGocPvwLdHFlX4aQSRItWUa5ZEO-zurzc8ZIxJz7GYN67xqxRbXZ8HGgHjUBey9zRAAUnKIf5Eik9Z2rL97yfkQojXZqsQjUg40NtYHToKa0agKTIhadXp9gkDvO-M1VwePBlPamV_OBkeiNC2beKhdvQT4RQ Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: b5d7c6ee418c41cb833e47c51ea4158b Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-DeleteServersTestJSON-284087079 Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 16:52:42.303050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 16:52:42.304282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:52:42.304282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-DeleteServersTestJSON-284087079 Jul 18 16:52:42.304282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: b5d7c6ee418c41cb833e47c51ea4158b Jul 18 16:52:42.304282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-DeleteServersTestJSON-284087079 Jul 18 16:52:42.304282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-DeleteServersTestJSON-284087079-project Jul 18 16:52:42.304282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 16:52:42.304282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 16:52:42.304282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: d6df4c3768134ebeb90d5566624a7cdd Jul 18 16:52:42.304282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-DeleteServersTestJSON-284087079-project Jul 18 16:52:42.304282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 16:52:42.304282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:42.304282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'server_id': '4dd8e166-14c8-46d5-80a3-a70d57745265'} Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:52:42.305091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:42.306198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:42.309880 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-defd7e9e-dea3-470e-a3ee-882448c36814 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Returning 404 to user: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:52:42.310988 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-defd7e9e-dea3-470e-a3ee-882448c36814 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042847 Jul 18 16:52:42.311694 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0456a1e3-b47f-4fa3-aa1b-e51e67470031 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:42.320261 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 97/190] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 16:52:42 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:52:42.320981 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0456a1e3-b47f-4fa3-aa1b-e51e67470031 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.213933 Jul 18 16:52:42.325117 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 94/191] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:42 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:43.338831 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-de3eef64-d233-480f-a436-debfb5fbc565 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:43.339625 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-de3eef64-d233-480f-a436-debfb5fbc565 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:43.341960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:43.347693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-de3eef64-d233-480f-a436-debfb5fbc565 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:43.348219 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-de3eef64-d233-480f-a436-debfb5fbc565 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:43.348982 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-de3eef64-d233-480f-a436-debfb5fbc565 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:43.349448 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-de3eef64-d233-480f-a436-debfb5fbc565 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:43.485166 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-de3eef64-d233-480f-a436-debfb5fbc565 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:43.492763 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-de3eef64-d233-480f-a436-debfb5fbc565 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.157802 Jul 18 16:52:43.493372 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 95/192] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:43 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:44.511328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-707026a2-ad5b-4d4d-8710-7217283f0455 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:44.512190 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-707026a2-ad5b-4d4d-8710-7217283f0455 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:44.520029 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-707026a2-ad5b-4d4d-8710-7217283f0455 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:44.520681 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-707026a2-ad5b-4d4d-8710-7217283f0455 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:44.528011 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-707026a2-ad5b-4d4d-8710-7217283f0455 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:44.528011 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-707026a2-ad5b-4d4d-8710-7217283f0455 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:44.531424 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:44.718054 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-707026a2-ad5b-4d4d-8710-7217283f0455 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:44.725812 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-707026a2-ad5b-4d4d-8710-7217283f0455 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.219002 Jul 18 16:52:44.726327 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 98/193] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:44 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:44.830391 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a8cbc063-35be-44ed-87a3-02936be99134 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:44.831292 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a8cbc063-35be-44ed-87a3-02936be99134 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:44.839911 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a8cbc063-35be-44ed-87a3-02936be99134 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:44.840730 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a8cbc063-35be-44ed-87a3-02936be99134 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:44.841782 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a8cbc063-35be-44ed-87a3-02936be99134 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:44.842225 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a8cbc063-35be-44ed-87a3-02936be99134 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:44.857506 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-a8cbc063-35be-44ed-87a3-02936be99134 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] HTTP exception thrown: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a8cbc063-35be-44ed-87a3-02936be99134 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Request method failure captured: Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: DELETE /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 HTTP/1.1 Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y-FI_z-0atxYJzblmwGocPvwLdHFlX4aQSRItWUa5ZEO-zurzc8ZIxJz7GYN67xqxRbXZ8HGgHjUBey9zRAAUnKIf5Eik9Z2rL97yfkQojXZqsQjUg40NtYHToKa0agKTIhadXp9gkDvO-M1VwePBlPamV_OBkeiNC2beKhdvQT4RQ Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: b5d7c6ee418c41cb833e47c51ea4158b Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-DeleteServersTestJSON-284087079 Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:52:44.863376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:52:44.864738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:52:44.864738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-DeleteServersTestJSON-284087079 Jul 18 16:52:44.864738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: b5d7c6ee418c41cb833e47c51ea4158b Jul 18 16:52:44.864738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-DeleteServersTestJSON-284087079 Jul 18 16:52:44.864738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-DeleteServersTestJSON-284087079-project Jul 18 16:52:44.864738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:52:44.864738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:52:44.864738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: d6df4c3768134ebeb90d5566624a7cdd Jul 18 16:52:44.864738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-DeleteServersTestJSON-284087079-project Jul 18 16:52:44.864738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 16:52:44.864738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:44.864738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '4dd8e166-14c8-46d5-80a3-a70d57745265'} Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:52:44.865437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:44.866470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:52:44.867533 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a8cbc063-35be-44ed-87a3-02936be99134 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Returning 404 to user: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:52:44.867533 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a8cbc063-35be-44ed-87a3-02936be99134 tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 404 len: 111 microversion: 2.1 time: 0.039578 Jul 18 16:52:44.867533 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 96/194] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 16:52:44 2022] DELETE /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:52:44.873710 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-668a5763-ce07-4e28-9290-d98d3355b1eb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:44.874335 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-668a5763-ce07-4e28-9290-d98d3355b1eb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] [instance: 4dd8e166-14c8-46d5-80a3-a70d57745265] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:44.882485 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-668a5763-ce07-4e28-9290-d98d3355b1eb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:44.882941 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-668a5763-ce07-4e28-9290-d98d3355b1eb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:44.883748 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-668a5763-ce07-4e28-9290-d98d3355b1eb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:44.884191 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-668a5763-ce07-4e28-9290-d98d3355b1eb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:44.900265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-668a5763-ce07-4e28-9290-d98d3355b1eb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] HTTP exception thrown: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-668a5763-ce07-4e28-9290-d98d3355b1eb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Request method failure captured: Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 HTTP/1.1 Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-FI_z-0atxYJzblmwGocPvwLdHFlX4aQSRItWUa5ZEO-zurzc8ZIxJz7GYN67xqxRbXZ8HGgHjUBey9zRAAUnKIf5Eik9Z2rL97yfkQojXZqsQjUg40NtYHToKa0agKTIhadXp9gkDvO-M1VwePBlPamV_OBkeiNC2beKhdvQT4RQ Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: b5d7c6ee418c41cb833e47c51ea4158b Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-DeleteServersTestJSON-284087079 Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 16:52:44.901459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 16:52:44.902661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b5d7c6ee418c41cb833e47c51ea4158b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:52:44.902661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-DeleteServersTestJSON-284087079 Jul 18 16:52:44.902661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: b5d7c6ee418c41cb833e47c51ea4158b Jul 18 16:52:44.902661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-DeleteServersTestJSON-284087079 Jul 18 16:52:44.902661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-DeleteServersTestJSON-284087079-project Jul 18 16:52:44.902661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 16:52:44.902661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 16:52:44.902661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: d6df4c3768134ebeb90d5566624a7cdd Jul 18 16:52:44.902661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-DeleteServersTestJSON-284087079-project Jul 18 16:52:44.902661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 16:52:44.902661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:44.902661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '4dd8e166-14c8-46d5-80a3-a70d57745265'} Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:52:44.903309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. Jul 18 16:52:44.904356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:52:44.905384 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-668a5763-ce07-4e28-9290-d98d3355b1eb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] Returning 404 to user: Instance 4dd8e166-14c8-46d5-80a3-a70d57745265 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:52:44.905384 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-668a5763-ce07-4e28-9290-d98d3355b1eb tempest-DeleteServersTestJSON-284087079 tempest-DeleteServersTestJSON-284087079-project] 10.222.0.76 "GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265" status: 404 len: 111 microversion: 2.1 time: 0.033173 Jul 18 16:52:44.905384 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 99/195] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:44 2022] GET /compute/v2.1/servers/4dd8e166-14c8-46d5-80a3-a70d57745265 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:52:45.744284 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-594660d2-87ee-430f-bb2c-4ea8e5b7d01b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:45.745019 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-594660d2-87ee-430f-bb2c-4ea8e5b7d01b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:45.752975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-594660d2-87ee-430f-bb2c-4ea8e5b7d01b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:45.753474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-594660d2-87ee-430f-bb2c-4ea8e5b7d01b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:45.754813 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-594660d2-87ee-430f-bb2c-4ea8e5b7d01b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:45.754813 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-594660d2-87ee-430f-bb2c-4ea8e5b7d01b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:45.996945 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-594660d2-87ee-430f-bb2c-4ea8e5b7d01b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:46.005332 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-594660d2-87ee-430f-bb2c-4ea8e5b7d01b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.265543 Jul 18 16:52:46.005910 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 97/196] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:45 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:47.023941 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2587ac41-f063-48d4-9b3a-b2983a545f02 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:47.024558 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2587ac41-f063-48d4-9b3a-b2983a545f02 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:47.035642 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2587ac41-f063-48d4-9b3a-b2983a545f02 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:47.036089 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2587ac41-f063-48d4-9b3a-b2983a545f02 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:47.039902 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2587ac41-f063-48d4-9b3a-b2983a545f02 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:47.040363 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2587ac41-f063-48d4-9b3a-b2983a545f02 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:47.418198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2587ac41-f063-48d4-9b3a-b2983a545f02 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:47.427665 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2587ac41-f063-48d4-9b3a-b2983a545f02 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.408538 Jul 18 16:52:47.428843 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 100/197] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:47 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:48.446464 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aee8b303-196d-4793-8e42-615bb9f50d92 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:48.447872 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aee8b303-196d-4793-8e42-615bb9f50d92 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:48.462068 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aee8b303-196d-4793-8e42-615bb9f50d92 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:48.462714 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aee8b303-196d-4793-8e42-615bb9f50d92 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:48.463688 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aee8b303-196d-4793-8e42-615bb9f50d92 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:48.464310 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aee8b303-196d-4793-8e42-615bb9f50d92 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:48.721906 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aee8b303-196d-4793-8e42-615bb9f50d92 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:48.729761 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aee8b303-196d-4793-8e42-615bb9f50d92 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.287608 Jul 18 16:52:48.730625 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 98/198] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:48 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:49.760189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-af513ebf-e995-4436-b27a-f1c99d3518b8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:49.761004 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-af513ebf-e995-4436-b27a-f1c99d3518b8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:49.769031 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af513ebf-e995-4436-b27a-f1c99d3518b8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:49.769689 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af513ebf-e995-4436-b27a-f1c99d3518b8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:49.771415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af513ebf-e995-4436-b27a-f1c99d3518b8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:49.772116 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af513ebf-e995-4436-b27a-f1c99d3518b8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:49.915170 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-af513ebf-e995-4436-b27a-f1c99d3518b8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:49.924157 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-af513ebf-e995-4436-b27a-f1c99d3518b8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.178602 Jul 18 16:52:49.924666 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 101/199] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:49 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:50.616883 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1760721891", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "networks": [{"uuid": "f3eb2857-7c8b-47cb-aa97-fb86cbe95d3f"}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:50.674391 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] validate_networks() for [('f3eb2857-7c8b-47cb-aa97-fb86cbe95d3f', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:52:50.941719 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6d61d4d4-2698-4e8b-b948-219205bee4a0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:50.942372 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6d61d4d4-2698-4e8b-b948-219205bee4a0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:50.948645 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d61d4d4-2698-4e8b-b948-219205bee4a0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:50.949241 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d61d4d4-2698-4e8b-b948-219205bee4a0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:50.950034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d61d4d4-2698-4e8b-b948-219205bee4a0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:50.950478 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d61d4d4-2698-4e8b-b948-219205bee4a0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:51.203131 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6d61d4d4-2698-4e8b-b948-219205bee4a0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:51.206713 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:52:51.207213 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:52:51.208712 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:52:51.209368 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:52:51.211429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:52:51.219090 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6d61d4d4-2698-4e8b-b948-219205bee4a0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.281266 Jul 18 16:52:51.219960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 102/200] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:50 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:51.225511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:51.226205 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:51.227009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:51.227450 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:51.252300 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Getting quotas for project 99ae4bdba9404be09aafe72858de5a18. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:52:51.257310 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Getting quotas for user 6809c29bee4041c393e6773643c63c2d and project 99ae4bdba9404be09aafe72858de5a18. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:52:51.268980 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:52:51.271290 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:52:51.416213 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-63b958e6-ef7d-4204-864c-ca818307b195 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803517 Jul 18 16:52:51.416774 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 99/201] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:52:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:52:51.427730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0b36ff89-81c8-4904-af72-d26ba3934488 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:51.428506 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0b36ff89-81c8-4904-af72-d26ba3934488 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:51.506439 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0b36ff89-81c8-4904-af72-d26ba3934488 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:51.513497 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0b36ff89-81c8-4904-af72-d26ba3934488 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1214 microversion: 2.1 time: 0.089695 Jul 18 16:52:51.514078 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 103/202] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:51 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:52.236801 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-72cc21f6-ca76-4a72-bfa6-f5d695006b37 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:52.237543 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-72cc21f6-ca76-4a72-bfa6-f5d695006b37 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:52.244816 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72cc21f6-ca76-4a72-bfa6-f5d695006b37 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:52.245325 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72cc21f6-ca76-4a72-bfa6-f5d695006b37 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:52.246181 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72cc21f6-ca76-4a72-bfa6-f5d695006b37 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:52.246957 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72cc21f6-ca76-4a72-bfa6-f5d695006b37 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:52.400413 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-72cc21f6-ca76-4a72-bfa6-f5d695006b37 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:52.412126 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-72cc21f6-ca76-4a72-bfa6-f5d695006b37 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.179636 Jul 18 16:52:52.412708 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 100/203] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:52 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:52.531180 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1022a8f9-0ebe-45f7-9842-eeaf74782372 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:52.535451 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1022a8f9-0ebe-45f7-9842-eeaf74782372 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:52.589424 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1022a8f9-0ebe-45f7-9842-eeaf74782372 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:52.597545 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1022a8f9-0ebe-45f7-9842-eeaf74782372 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1214 microversion: 2.1 time: 0.070382 Jul 18 16:52:52.598302 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 104/204] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:52 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:53.432740 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9b977b58-170f-452f-93ef-f3f75873fff2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:53.435375 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9b977b58-170f-452f-93ef-f3f75873fff2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:53.441694 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9b977b58-170f-452f-93ef-f3f75873fff2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.443796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9b977b58-170f-452f-93ef-f3f75873fff2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.443796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9b977b58-170f-452f-93ef-f3f75873fff2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.443796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9b977b58-170f-452f-93ef-f3f75873fff2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.617580 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e50c8646-637c-411f-9d12-6b6af184a1f6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:53.618197 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e50c8646-637c-411f-9d12-6b6af184a1f6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:53.626312 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e50c8646-637c-411f-9d12-6b6af184a1f6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.626743 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e50c8646-637c-411f-9d12-6b6af184a1f6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.627634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e50c8646-637c-411f-9d12-6b6af184a1f6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.628065 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e50c8646-637c-411f-9d12-6b6af184a1f6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.667865 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9b977b58-170f-452f-93ef-f3f75873fff2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:53.676936 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9b977b58-170f-452f-93ef-f3f75873fff2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.248033 Jul 18 16:52:53.677654 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 101/205] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:53 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:53.701374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e50c8646-637c-411f-9d12-6b6af184a1f6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:53.708596 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e50c8646-637c-411f-9d12-6b6af184a1f6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1266 microversion: 2.1 time: 0.096968 Jul 18 16:52:53.709214 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 105/206] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:53 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:54.695984 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-77957439-4836-4fd5-be42-8d88b8b98028 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:54.697670 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-77957439-4836-4fd5-be42-8d88b8b98028 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:54.709356 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-77957439-4836-4fd5-be42-8d88b8b98028 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:54.710346 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-77957439-4836-4fd5-be42-8d88b8b98028 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:54.712480 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-77957439-4836-4fd5-be42-8d88b8b98028 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:54.713685 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-77957439-4836-4fd5-be42-8d88b8b98028 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:54.727965 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-23c6dc5f-6db8-49b6-826c-97284514e1e4 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:54.728733 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-23c6dc5f-6db8-49b6-826c-97284514e1e4 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:54.735139 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=58 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:54.736950 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23c6dc5f-6db8-49b6-826c-97284514e1e4 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:54.737595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23c6dc5f-6db8-49b6-826c-97284514e1e4 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:54.738673 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23c6dc5f-6db8-49b6-826c-97284514e1e4 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:54.739305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23c6dc5f-6db8-49b6-826c-97284514e1e4 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:54.843917 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-23c6dc5f-6db8-49b6-826c-97284514e1e4 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:54.854450 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-23c6dc5f-6db8-49b6-826c-97284514e1e4 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1274 microversion: 2.1 time: 0.132071 Jul 18 16:52:54.865577 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 106/207] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:54 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1274 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:54.873631 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-77957439-4836-4fd5-be42-8d88b8b98028 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:54.883085 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-77957439-4836-4fd5-be42-8d88b8b98028 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.191538 Jul 18 16:52:54.883929 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 102/208] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:54 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:55.871750 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cfd1132d-23e1-4eec-8976-85f0fa6cf3ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:55.872992 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cfd1132d-23e1-4eec-8976-85f0fa6cf3ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:55.879872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfd1132d-23e1-4eec-8976-85f0fa6cf3ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:55.880531 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfd1132d-23e1-4eec-8976-85f0fa6cf3ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:55.881516 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfd1132d-23e1-4eec-8976-85f0fa6cf3ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:55.882117 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfd1132d-23e1-4eec-8976-85f0fa6cf3ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:55.899821 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-46b20256-fe7b-40a5-be1b-fc97eae1332a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:55.901150 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-46b20256-fe7b-40a5-be1b-fc97eae1332a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:55.915926 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-46b20256-fe7b-40a5-be1b-fc97eae1332a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:55.916603 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-46b20256-fe7b-40a5-be1b-fc97eae1332a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:55.917592 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-46b20256-fe7b-40a5-be1b-fc97eae1332a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:55.918202 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-46b20256-fe7b-40a5-be1b-fc97eae1332a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:56.073300 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cfd1132d-23e1-4eec-8976-85f0fa6cf3ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:56.088733 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cfd1132d-23e1-4eec-8976-85f0fa6cf3ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.219897 Jul 18 16:52:56.089762 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 107/209] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:55 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:56.180710 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-46b20256-fe7b-40a5-be1b-fc97eae1332a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:56.194487 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-46b20256-fe7b-40a5-be1b-fc97eae1332a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.298408 Jul 18 16:52:56.227979 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 103/210] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:55 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:56.912598 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-16687ec0-29dd-4629-a817-92e80f3d239b req-c4f6d704-f126-4660-8fa4-ef50eca4c8bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0877c3d6-87eb-4aa3-b43a-ef6d2ceac308", "tag": "53c4413d-7df9-4bcc-a395-5f1e1810a1df"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:56.925283 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-16687ec0-29dd-4629-a817-92e80f3d239b req-c4f6d704-f126-4660-8fa4-ef50eca4c8bf service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:56.926022 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-16687ec0-29dd-4629-a817-92e80f3d239b req-c4f6d704-f126-4660-8fa4-ef50eca4c8bf service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:56.963755 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-16687ec0-29dd-4629-a817-92e80f3d239b req-c4f6d704-f126-4660-8fa4-ef50eca4c8bf service nova] Creating event network-changed:53c4413d-7df9-4bcc-a395-5f1e1810a1df for instance 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 on hv-cinder-83754 Jul 18 16:52:56.985578 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-16687ec0-29dd-4629-a817-92e80f3d239b req-c4f6d704-f126-4660-8fa4-ef50eca4c8bf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079189 Jul 18 16:52:56.991616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 108/211] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:52:57.113360 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7a2a17f3-7fec-469e-a497-7e841fdde484 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:57.119883 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7a2a17f3-7fec-469e-a497-7e841fdde484 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:57.127112 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a2a17f3-7fec-469e-a497-7e841fdde484 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:57.128523 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a2a17f3-7fec-469e-a497-7e841fdde484 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:57.129689 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a2a17f3-7fec-469e-a497-7e841fdde484 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:57.130425 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a2a17f3-7fec-469e-a497-7e841fdde484 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:57.214548 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ba0faf82-a3f4-483f-85e2-796bb3c81e61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:57.215509 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ba0faf82-a3f4-483f-85e2-796bb3c81e61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:57.222995 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba0faf82-a3f4-483f-85e2-796bb3c81e61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:57.223809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba0faf82-a3f4-483f-85e2-796bb3c81e61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:57.225150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba0faf82-a3f4-483f-85e2-796bb3c81e61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:57.225807 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba0faf82-a3f4-483f-85e2-796bb3c81e61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:57.470418 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7a2a17f3-7fec-469e-a497-7e841fdde484 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:57.481288 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7a2a17f3-7fec-469e-a497-7e841fdde484 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.378756 Jul 18 16:52:57.481864 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 104/212] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:57 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:57.660033 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ba0faf82-a3f4-483f-85e2-796bb3c81e61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:57.674160 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ba0faf82-a3f4-483f-85e2-796bb3c81e61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.463523 Jul 18 16:52:57.685058 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 109/213] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:57 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:58.508667 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c0404fd5-0c29-4ca9-92d2-7ac60bf5dc12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:58.509956 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c0404fd5-0c29-4ca9-92d2-7ac60bf5dc12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:58.518680 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c0404fd5-0c29-4ca9-92d2-7ac60bf5dc12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:58.519466 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c0404fd5-0c29-4ca9-92d2-7ac60bf5dc12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:58.520569 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c0404fd5-0c29-4ca9-92d2-7ac60bf5dc12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:58.521197 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c0404fd5-0c29-4ca9-92d2-7ac60bf5dc12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:58.692521 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d8875be1-671f-442e-888c-7635aeaea93e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:58.693940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d8875be1-671f-442e-888c-7635aeaea93e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:58.699832 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8875be1-671f-442e-888c-7635aeaea93e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:58.700514 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8875be1-671f-442e-888c-7635aeaea93e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:58.701563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8875be1-671f-442e-888c-7635aeaea93e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:58.702140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8875be1-671f-442e-888c-7635aeaea93e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:58.846904 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c0404fd5-0c29-4ca9-92d2-7ac60bf5dc12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:58.849834 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c0404fd5-0c29-4ca9-92d2-7ac60bf5dc12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.345625 Jul 18 16:52:58.850652 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 105/214] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:58 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:58.904231 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d8875be1-671f-442e-888c-7635aeaea93e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:58.918043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d8875be1-671f-442e-888c-7635aeaea93e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.229386 Jul 18 16:52:58.918887 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 110/215] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:58 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:59.867477 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-09f09dcc-c6ed-42d4-92d7-0fa72c5cafa1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:59.868006 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3676eb88-6fe5-4af9-b74e-1973976658b4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Action: 'create', calling method: .version_select at 0x7f4af176a9d0>, body: {"keypair": {"name": "tempest-keypair-1449833633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAglAzFW255SxjPWPVYx2GKMOR5DK83HamSwAjKDO2mfLtsdAOiW4iFmWBF2KHaWWMP59X0Xg2rfm30bNVzPbP4LMdO0Cq+Dxzw68ZAchz2lqTgcAWUi8opgo0K/3nx4g=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:59.872673 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-09f09dcc-c6ed-42d4-92d7-0fa72c5cafa1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:59.874320 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09f09dcc-c6ed-42d4-92d7-0fa72c5cafa1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:59.875387 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09f09dcc-c6ed-42d4-92d7-0fa72c5cafa1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:59.876165 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09f09dcc-c6ed-42d4-92d7-0fa72c5cafa1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:59.876664 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09f09dcc-c6ed-42d4-92d7-0fa72c5cafa1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:59.882305 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-3676eb88-6fe5-4af9-b74e-1973976658b4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Getting quotas for project d713a57b50cf4fe3b0fc1bd63cb761fd. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:52:59.886323 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-3676eb88-6fe5-4af9-b74e-1973976658b4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Getting quotas for user 7b98162f0ce8462fa1a20871ab1a6560 and project d713a57b50cf4fe3b0fc1bd63cb761fd. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:53:00.012517 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-09f09dcc-c6ed-42d4-92d7-0fa72c5cafa1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:00.020317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-09f09dcc-c6ed-42d4-92d7-0fa72c5cafa1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.156717 Jul 18 16:53:00.021311 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 111/216] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:59 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:00.025454 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c2126cea-9f61-40df-8505-4d22ff4c34c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:00.026056 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c2126cea-9f61-40df-8505-4d22ff4c34c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:00.031785 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c2126cea-9f61-40df-8505-4d22ff4c34c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:00.032264 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c2126cea-9f61-40df-8505-4d22ff4c34c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:00.033085 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c2126cea-9f61-40df-8505-4d22ff4c34c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:00.033530 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c2126cea-9f61-40df-8505-4d22ff4c34c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:00.063871 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3676eb88-6fe5-4af9-b74e-1973976658b4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.323038 Jul 18 16:53:00.064837 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 106/217] 10.222.0.76 () {60 vars in 1158 bytes} [Mon Jul 18 16:52:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:00.173835 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c2126cea-9f61-40df-8505-4d22ff4c34c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:00.181370 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c2126cea-9f61-40df-8505-4d22ff4c34c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.159301 Jul 18 16:53:00.182002 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 112/218] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:00 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:01.037197 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4e1e54eb-df1b-4d2b-9b06-c5fa297b457d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:01.037806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4e1e54eb-df1b-4d2b-9b06-c5fa297b457d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:01.045276 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e1e54eb-df1b-4d2b-9b06-c5fa297b457d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:01.045743 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e1e54eb-df1b-4d2b-9b06-c5fa297b457d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:01.046537 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e1e54eb-df1b-4d2b-9b06-c5fa297b457d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:01.046971 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e1e54eb-df1b-4d2b-9b06-c5fa297b457d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:01.049826 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:01.200687 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a005c85c-9e8a-45c5-8145-a14c82e34a84 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:01.201556 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a005c85c-9e8a-45c5-8145-a14c82e34a84 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:01.209004 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a005c85c-9e8a-45c5-8145-a14c82e34a84 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:01.209482 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a005c85c-9e8a-45c5-8145-a14c82e34a84 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:01.210418 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a005c85c-9e8a-45c5-8145-a14c82e34a84 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:01.210859 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a005c85c-9e8a-45c5-8145-a14c82e34a84 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:01.237374 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:01.247388 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4e1e54eb-df1b-4d2b-9b06-c5fa297b457d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:01.254974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4e1e54eb-df1b-4d2b-9b06-c5fa297b457d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.221455 Jul 18 16:53:01.255491 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 107/219] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:01 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:01.369610 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a005c85c-9e8a-45c5-8145-a14c82e34a84 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:01.393415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a005c85c-9e8a-45c5-8145-a14c82e34a84 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.197338 Jul 18 16:53:01.395467 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 113/220] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:01 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:02.276932 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-afa16ac7-42f2-473e-ac45-08e589b6ebfa tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:02.277608 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-afa16ac7-42f2-473e-ac45-08e589b6ebfa tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:02.290414 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-afa16ac7-42f2-473e-ac45-08e589b6ebfa tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:02.290876 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-afa16ac7-42f2-473e-ac45-08e589b6ebfa tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:02.291661 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-afa16ac7-42f2-473e-ac45-08e589b6ebfa tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:02.292117 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-afa16ac7-42f2-473e-ac45-08e589b6ebfa tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:02.411320 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fad339a5-0f96-46f2-ada3-e6aab29190bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:02.412595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fad339a5-0f96-46f2-ada3-e6aab29190bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:02.420644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fad339a5-0f96-46f2-ada3-e6aab29190bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:02.422029 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fad339a5-0f96-46f2-ada3-e6aab29190bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:02.423126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fad339a5-0f96-46f2-ada3-e6aab29190bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:02.423759 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fad339a5-0f96-46f2-ada3-e6aab29190bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:02.450701 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-afa16ac7-42f2-473e-ac45-08e589b6ebfa tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:02.463645 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-afa16ac7-42f2-473e-ac45-08e589b6ebfa tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.194217 Jul 18 16:53:02.464229 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 108/221] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:02 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:02.594370 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=4 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:02.664637 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fad339a5-0f96-46f2-ada3-e6aab29190bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:02.682327 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fad339a5-0f96-46f2-ada3-e6aab29190bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.270015 Jul 18 16:53:02.682327 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 114/222] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:02 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:03.302263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-961540547", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac86b6c7-541a-476d-96e8-030cd9ab03ec"}], "security_groups": [{"name": "tempest-securitygroup--1364324511"}], "key_name": "tempest-keypair-1449833633", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:03.450902 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] validate_networks() for [('ac86b6c7-541a-476d-96e8-030cd9ab03ec', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:53:03.481219 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-647f0e10-a9e0-4984-8066-95bede16ab12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:03.483593 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-647f0e10-a9e0-4984-8066-95bede16ab12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:03.488087 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-647f0e10-a9e0-4984-8066-95bede16ab12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:03.488544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-647f0e10-a9e0-4984-8066-95bede16ab12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:03.489340 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-647f0e10-a9e0-4984-8066-95bede16ab12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:03.489778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-647f0e10-a9e0-4984-8066-95bede16ab12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:03.706412 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-647f0e10-a9e0-4984-8066-95bede16ab12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:03.714725 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-647f0e10-a9e0-4984-8066-95bede16ab12 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.237604 Jul 18 16:53:03.715357 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 115/223] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:03 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:03.720639 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b5a5ef86-0676-4f8e-a4fc-742a04619f15 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:03.721374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b5a5ef86-0676-4f8e-a4fc-742a04619f15 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:03.728151 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5a5ef86-0676-4f8e-a4fc-742a04619f15 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:03.728706 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5a5ef86-0676-4f8e-a4fc-742a04619f15 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:03.729522 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5a5ef86-0676-4f8e-a4fc-742a04619f15 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:03.730002 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5a5ef86-0676-4f8e-a4fc-742a04619f15 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:03.942157 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b5a5ef86-0676-4f8e-a4fc-742a04619f15 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:03.950765 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b5a5ef86-0676-4f8e-a4fc-742a04619f15 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.234173 Jul 18 16:53:03.951474 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 116/224] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:03 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:04.301162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:53:04.301614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:53:04.302085 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:53:04.302492 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:53:04.303049 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:53:04.311677 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:04.312132 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:04.313549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:04.313982 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:04.331848 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Getting quotas for project d713a57b50cf4fe3b0fc1bd63cb761fd. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:53:04.335659 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Getting quotas for user 7b98162f0ce8462fa1a20871ab1a6560 and project d713a57b50cf4fe3b0fc1bd63cb761fd. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:53:04.347453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:53:04.349573 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:53:04.503421 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9debcdc9-b9bb-4efb-9df6-aa2ec5a8739b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.209071 Jul 18 16:53:04.503989 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 109/225] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:53:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:53:04.514692 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-190f1c28-7c81-4da4-a44c-7cf42a60db0e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:04.515887 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-190f1c28-7c81-4da4-a44c-7cf42a60db0e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:04.573667 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-190f1c28-7c81-4da4-a44c-7cf42a60db0e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:04.581235 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-190f1c28-7c81-4da4-a44c-7cf42a60db0e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1237 microversion: 2.1 time: 0.070456 Jul 18 16:53:04.581856 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 117/226] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:04 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:04.732207 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5bb5c492-1fdb-4808-b1c5-35cbed3a5a80 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:04.732838 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5bb5c492-1fdb-4808-b1c5-35cbed3a5a80 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:04.739676 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5bb5c492-1fdb-4808-b1c5-35cbed3a5a80 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:04.740125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5bb5c492-1fdb-4808-b1c5-35cbed3a5a80 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:04.740917 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5bb5c492-1fdb-4808-b1c5-35cbed3a5a80 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:04.741380 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5bb5c492-1fdb-4808-b1c5-35cbed3a5a80 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:04.879252 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5bb5c492-1fdb-4808-b1c5-35cbed3a5a80 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:04.887133 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5bb5c492-1fdb-4808-b1c5-35cbed3a5a80 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.159156 Jul 18 16:53:04.887693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 110/227] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:04 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:04.968982 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2e4a946c-1847-447e-b56b-129c6a2a8f72 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:04.969616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2e4a946c-1847-447e-b56b-129c6a2a8f72 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:04.975908 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2e4a946c-1847-447e-b56b-129c6a2a8f72 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:04.976363 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2e4a946c-1847-447e-b56b-129c6a2a8f72 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:04.977160 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2e4a946c-1847-447e-b56b-129c6a2a8f72 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:04.977596 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2e4a946c-1847-447e-b56b-129c6a2a8f72 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:05.122139 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2e4a946c-1847-447e-b56b-129c6a2a8f72 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:05.135414 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2e4a946c-1847-447e-b56b-129c6a2a8f72 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.170268 Jul 18 16:53:05.137076 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 118/228] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:04 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:05.598497 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f70a70c9-aa8a-4633-b7e8-d60ca2934040 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:05.599051 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f70a70c9-aa8a-4633-b7e8-d60ca2934040 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:05.653252 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f70a70c9-aa8a-4633-b7e8-d60ca2934040 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:05.660973 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f70a70c9-aa8a-4633-b7e8-d60ca2934040 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1237 microversion: 2.1 time: 0.066562 Jul 18 16:53:05.661659 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 111/229] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:05 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:05.905954 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1de1828c-3c98-464b-81fe-257bf22fc4d0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:05.906440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1de1828c-3c98-464b-81fe-257bf22fc4d0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:05.912510 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1de1828c-3c98-464b-81fe-257bf22fc4d0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:05.912956 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1de1828c-3c98-464b-81fe-257bf22fc4d0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:05.913752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1de1828c-3c98-464b-81fe-257bf22fc4d0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:05.914265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1de1828c-3c98-464b-81fe-257bf22fc4d0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:05.919188 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:06.049687 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1de1828c-3c98-464b-81fe-257bf22fc4d0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:06.057298 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1de1828c-3c98-464b-81fe-257bf22fc4d0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.156141 Jul 18 16:53:06.057910 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 119/230] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:05 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:06.153778 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-227cc68d-84b1-475c-9002-f04b34879080 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:06.154462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-227cc68d-84b1-475c-9002-f04b34879080 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:06.161699 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-227cc68d-84b1-475c-9002-f04b34879080 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:06.162747 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-227cc68d-84b1-475c-9002-f04b34879080 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:06.163570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-227cc68d-84b1-475c-9002-f04b34879080 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:06.163968 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-227cc68d-84b1-475c-9002-f04b34879080 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:06.314287 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-227cc68d-84b1-475c-9002-f04b34879080 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:06.321993 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-227cc68d-84b1-475c-9002-f04b34879080 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.172184 Jul 18 16:53:06.322690 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 112/231] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:06 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:06.678056 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8e6d12e4-bff3-4eb7-943d-65f8854335a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:06.678667 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8e6d12e4-bff3-4eb7-943d-65f8854335a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:06.685143 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e6d12e4-bff3-4eb7-943d-65f8854335a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:06.685600 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e6d12e4-bff3-4eb7-943d-65f8854335a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:06.686366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e6d12e4-bff3-4eb7-943d-65f8854335a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:06.686806 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e6d12e4-bff3-4eb7-943d-65f8854335a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:06.750820 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8e6d12e4-bff3-4eb7-943d-65f8854335a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:06.758857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8e6d12e4-bff3-4eb7-943d-65f8854335a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1241 microversion: 2.1 time: 0.084739 Jul 18 16:53:06.761810 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 120/232] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:06 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:07.075420 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ac9d4b4f-20c0-433f-a356-dd9ed6930321 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:07.076031 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ac9d4b4f-20c0-433f-a356-dd9ed6930321 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:07.083198 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac9d4b4f-20c0-433f-a356-dd9ed6930321 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:07.083654 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac9d4b4f-20c0-433f-a356-dd9ed6930321 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:07.084419 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac9d4b4f-20c0-433f-a356-dd9ed6930321 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:07.084861 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac9d4b4f-20c0-433f-a356-dd9ed6930321 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:07.220898 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ac9d4b4f-20c0-433f-a356-dd9ed6930321 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:07.229757 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ac9d4b4f-20c0-433f-a356-dd9ed6930321 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.158171 Jul 18 16:53:07.230329 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 113/233] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:07 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:07.338187 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-47bee000-e217-41ce-933e-195a32a49bd5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:07.338777 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-47bee000-e217-41ce-933e-195a32a49bd5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:07.345284 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-47bee000-e217-41ce-933e-195a32a49bd5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:07.345732 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-47bee000-e217-41ce-933e-195a32a49bd5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:07.346515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-47bee000-e217-41ce-933e-195a32a49bd5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:07.346977 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-47bee000-e217-41ce-933e-195a32a49bd5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:07.483275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-47bee000-e217-41ce-933e-195a32a49bd5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:07.492197 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-47bee000-e217-41ce-933e-195a32a49bd5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.157825 Jul 18 16:53:07.492764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 121/234] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:07 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:07.776950 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f50495ea-a5a7-4b5d-8cbc-205bf878b4fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:07.777719 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f50495ea-a5a7-4b5d-8cbc-205bf878b4fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:07.784592 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f50495ea-a5a7-4b5d-8cbc-205bf878b4fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:07.785024 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f50495ea-a5a7-4b5d-8cbc-205bf878b4fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:07.785804 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f50495ea-a5a7-4b5d-8cbc-205bf878b4fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:07.786243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f50495ea-a5a7-4b5d-8cbc-205bf878b4fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:07.847044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f50495ea-a5a7-4b5d-8cbc-205bf878b4fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:07.854459 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f50495ea-a5a7-4b5d-8cbc-205bf878b4fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1241 microversion: 2.1 time: 0.082268 Jul 18 16:53:07.855016 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 114/235] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:07 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:08.248177 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5d9b4fa8-5558-401b-b1a9-ff9b2d36bdba tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:08.248177 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5d9b4fa8-5558-401b-b1a9-ff9b2d36bdba tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:08.253700 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d9b4fa8-5558-401b-b1a9-ff9b2d36bdba tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:08.254142 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d9b4fa8-5558-401b-b1a9-ff9b2d36bdba tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:08.254922 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d9b4fa8-5558-401b-b1a9-ff9b2d36bdba tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:08.255386 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d9b4fa8-5558-401b-b1a9-ff9b2d36bdba tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:08.390007 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5d9b4fa8-5558-401b-b1a9-ff9b2d36bdba tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:08.397765 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5d9b4fa8-5558-401b-b1a9-ff9b2d36bdba tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.155292 Jul 18 16:53:08.398539 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 122/236] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:08 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:08.511713 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-237d570f-18fe-4d20-8ec2-428dc55e5b7d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:08.512311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-237d570f-18fe-4d20-8ec2-428dc55e5b7d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:08.519086 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-237d570f-18fe-4d20-8ec2-428dc55e5b7d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:08.519536 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-237d570f-18fe-4d20-8ec2-428dc55e5b7d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:08.520299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-237d570f-18fe-4d20-8ec2-428dc55e5b7d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:08.520738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-237d570f-18fe-4d20-8ec2-428dc55e5b7d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:08.663229 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-237d570f-18fe-4d20-8ec2-428dc55e5b7d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:08.670829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-237d570f-18fe-4d20-8ec2-428dc55e5b7d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.163037 Jul 18 16:53:08.682536 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 115/237] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:08 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:08.871744 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1f96d89a-1e7f-43e9-9a02-16164be2a221 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:08.872276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1f96d89a-1e7f-43e9-9a02-16164be2a221 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:08.878433 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1f96d89a-1e7f-43e9-9a02-16164be2a221 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:08.878884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1f96d89a-1e7f-43e9-9a02-16164be2a221 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:08.883712 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1f96d89a-1e7f-43e9-9a02-16164be2a221 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:08.883712 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1f96d89a-1e7f-43e9-9a02-16164be2a221 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:08.942254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1f96d89a-1e7f-43e9-9a02-16164be2a221 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:08.950149 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1f96d89a-1e7f-43e9-9a02-16164be2a221 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1241 microversion: 2.1 time: 0.082261 Jul 18 16:53:08.950716 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 123/238] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:08 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:09.415180 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-81e6da65-048b-4a15-a504-0095cb39a1de tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:09.415791 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-81e6da65-048b-4a15-a504-0095cb39a1de tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:09.421911 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81e6da65-048b-4a15-a504-0095cb39a1de tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:09.422945 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81e6da65-048b-4a15-a504-0095cb39a1de tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:09.423722 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81e6da65-048b-4a15-a504-0095cb39a1de tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:09.424166 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81e6da65-048b-4a15-a504-0095cb39a1de tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:09.556174 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-81e6da65-048b-4a15-a504-0095cb39a1de tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:09.563675 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-81e6da65-048b-4a15-a504-0095cb39a1de tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.152373 Jul 18 16:53:09.564234 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 116/239] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:09 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:09.689186 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a9cfc4a1-15ca-4726-bfc2-11ac4b536c35 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:09.689846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a9cfc4a1-15ca-4726-bfc2-11ac4b536c35 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:09.696114 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a9cfc4a1-15ca-4726-bfc2-11ac4b536c35 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:09.696569 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a9cfc4a1-15ca-4726-bfc2-11ac4b536c35 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:09.697375 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a9cfc4a1-15ca-4726-bfc2-11ac4b536c35 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:09.697817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a9cfc4a1-15ca-4726-bfc2-11ac4b536c35 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:09.837343 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a9cfc4a1-15ca-4726-bfc2-11ac4b536c35 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:09.845824 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a9cfc4a1-15ca-4726-bfc2-11ac4b536c35 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.160353 Jul 18 16:53:09.848156 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 124/240] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:09 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:09.967743 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bc92b08b-454d-4ca8-8691-c147117d1699 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:09.968353 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bc92b08b-454d-4ca8-8691-c147117d1699 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:09.974692 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bc92b08b-454d-4ca8-8691-c147117d1699 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:09.975209 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bc92b08b-454d-4ca8-8691-c147117d1699 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:09.976070 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bc92b08b-454d-4ca8-8691-c147117d1699 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:09.976507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bc92b08b-454d-4ca8-8691-c147117d1699 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:10.042233 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-bc92b08b-454d-4ca8-8691-c147117d1699 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:10.049749 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bc92b08b-454d-4ca8-8691-c147117d1699 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1241 microversion: 2.1 time: 0.085897 Jul 18 16:53:10.050303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 117/241] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:09 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:10.580183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7a5c2512-4a28-4572-9896-4ab79931d8b6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:10.580789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7a5c2512-4a28-4572-9896-4ab79931d8b6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:10.586899 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7a5c2512-4a28-4572-9896-4ab79931d8b6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:10.587355 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7a5c2512-4a28-4572-9896-4ab79931d8b6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:10.588120 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7a5c2512-4a28-4572-9896-4ab79931d8b6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:10.588554 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7a5c2512-4a28-4572-9896-4ab79931d8b6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:10.736480 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7a5c2512-4a28-4572-9896-4ab79931d8b6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:10.751927 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7a5c2512-4a28-4572-9896-4ab79931d8b6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.168196 Jul 18 16:53:10.753716 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 125/242] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:10 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:10.865549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1b88029e-5ce2-414c-b5c3-da05d754be9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:10.866181 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1b88029e-5ce2-414c-b5c3-da05d754be9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:10.872667 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1b88029e-5ce2-414c-b5c3-da05d754be9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:10.873150 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1b88029e-5ce2-414c-b5c3-da05d754be9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:10.873921 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1b88029e-5ce2-414c-b5c3-da05d754be9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:10.874356 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1b88029e-5ce2-414c-b5c3-da05d754be9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:11.019275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1b88029e-5ce2-414c-b5c3-da05d754be9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:11.027488 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1b88029e-5ce2-414c-b5c3-da05d754be9f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.165896 Jul 18 16:53:11.028057 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 118/243] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:10 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:11.067282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bddc8580-d29e-48af-b79f-9308e85c28eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:11.068013 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bddc8580-d29e-48af-b79f-9308e85c28eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:11.074221 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bddc8580-d29e-48af-b79f-9308e85c28eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:11.074673 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bddc8580-d29e-48af-b79f-9308e85c28eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:11.075453 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bddc8580-d29e-48af-b79f-9308e85c28eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:11.075894 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bddc8580-d29e-48af-b79f-9308e85c28eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:11.137813 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bddc8580-d29e-48af-b79f-9308e85c28eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:11.148822 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bddc8580-d29e-48af-b79f-9308e85c28eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1241 microversion: 2.1 time: 0.082881 Jul 18 16:53:11.148822 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 126/244] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:11 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:11.760779 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8a01a232-2670-4283-9d36-bacb4d20691f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:11.761440 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8a01a232-2670-4283-9d36-bacb4d20691f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:11.768310 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8a01a232-2670-4283-9d36-bacb4d20691f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:11.768751 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8a01a232-2670-4283-9d36-bacb4d20691f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:11.769540 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8a01a232-2670-4283-9d36-bacb4d20691f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:11.769972 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8a01a232-2670-4283-9d36-bacb4d20691f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:11.900839 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8a01a232-2670-4283-9d36-bacb4d20691f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:11.908485 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8a01a232-2670-4283-9d36-bacb4d20691f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.151512 Jul 18 16:53:11.909074 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 119/245] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:11 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:12.044885 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b90a5a68-a5dc-47e9-9f98-19f071659768 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:12.045530 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b90a5a68-a5dc-47e9-9f98-19f071659768 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:12.052211 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b90a5a68-a5dc-47e9-9f98-19f071659768 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:12.052660 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b90a5a68-a5dc-47e9-9f98-19f071659768 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:12.053463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b90a5a68-a5dc-47e9-9f98-19f071659768 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:12.053903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b90a5a68-a5dc-47e9-9f98-19f071659768 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:12.164044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d0ef2fcd-f871-46b3-977f-a29727f7759a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:12.164928 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d0ef2fcd-f871-46b3-977f-a29727f7759a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:12.171423 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d0ef2fcd-f871-46b3-977f-a29727f7759a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:12.171868 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d0ef2fcd-f871-46b3-977f-a29727f7759a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:12.174102 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d0ef2fcd-f871-46b3-977f-a29727f7759a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:12.174586 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d0ef2fcd-f871-46b3-977f-a29727f7759a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:12.196250 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b90a5a68-a5dc-47e9-9f98-19f071659768 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:12.204153 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b90a5a68-a5dc-47e9-9f98-19f071659768 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.162884 Jul 18 16:53:12.204731 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 127/246] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:12 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:12.244052 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d0ef2fcd-f871-46b3-977f-a29727f7759a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:12.251739 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d0ef2fcd-f871-46b3-977f-a29727f7759a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1241 microversion: 2.1 time: 0.091759 Jul 18 16:53:12.252310 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 120/247] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:12 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:12.926876 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a890da84-fe5d-442e-94cb-ae5e2ff2a39d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:12.927482 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a890da84-fe5d-442e-94cb-ae5e2ff2a39d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:12.933534 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a890da84-fe5d-442e-94cb-ae5e2ff2a39d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:12.933980 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a890da84-fe5d-442e-94cb-ae5e2ff2a39d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:12.934738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a890da84-fe5d-442e-94cb-ae5e2ff2a39d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:12.935171 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a890da84-fe5d-442e-94cb-ae5e2ff2a39d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:13.066874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a890da84-fe5d-442e-94cb-ae5e2ff2a39d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:13.074583 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a890da84-fe5d-442e-94cb-ae5e2ff2a39d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.152395 Jul 18 16:53:13.075153 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 128/248] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:12 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:13.221334 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-72e0dc97-0d55-4627-b537-d2b24afaa689 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:13.222017 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-72e0dc97-0d55-4627-b537-d2b24afaa689 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:13.228833 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72e0dc97-0d55-4627-b537-d2b24afaa689 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:13.229258 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72e0dc97-0d55-4627-b537-d2b24afaa689 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:13.230027 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72e0dc97-0d55-4627-b537-d2b24afaa689 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:13.230461 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72e0dc97-0d55-4627-b537-d2b24afaa689 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:13.268524 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8bac3d66-8506-4805-99d9-a64f9176065f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:13.269183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8bac3d66-8506-4805-99d9-a64f9176065f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:13.276041 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8bac3d66-8506-4805-99d9-a64f9176065f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:13.276486 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8bac3d66-8506-4805-99d9-a64f9176065f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:13.277298 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8bac3d66-8506-4805-99d9-a64f9176065f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:13.277728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8bac3d66-8506-4805-99d9-a64f9176065f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:13.347105 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8bac3d66-8506-4805-99d9-a64f9176065f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:13.355106 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8bac3d66-8506-4805-99d9-a64f9176065f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1241 microversion: 2.1 time: 0.091168 Jul 18 16:53:13.355692 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 129/249] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:13 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:13.365788 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-72e0dc97-0d55-4627-b537-d2b24afaa689 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:13.373450 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-72e0dc97-0d55-4627-b537-d2b24afaa689 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.156098 Jul 18 16:53:13.374108 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 121/250] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:13 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:14.091325 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ef9a13de-2920-4b34-89b8-e3e5c2e22813 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:14.091934 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ef9a13de-2920-4b34-89b8-e3e5c2e22813 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:14.098639 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ef9a13de-2920-4b34-89b8-e3e5c2e22813 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:14.099093 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ef9a13de-2920-4b34-89b8-e3e5c2e22813 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:14.099860 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ef9a13de-2920-4b34-89b8-e3e5c2e22813 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:14.100298 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ef9a13de-2920-4b34-89b8-e3e5c2e22813 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:14.233666 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ef9a13de-2920-4b34-89b8-e3e5c2e22813 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:14.241920 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ef9a13de-2920-4b34-89b8-e3e5c2e22813 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.154488 Jul 18 16:53:14.242491 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 130/251] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:14 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:14.373299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-830f332b-70f0-415d-bf5e-ab9752d88821 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:14.373816 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-830f332b-70f0-415d-bf5e-ab9752d88821 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:14.376449 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:14.381353 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-830f332b-70f0-415d-bf5e-ab9752d88821 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:14.381805 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-830f332b-70f0-415d-bf5e-ab9752d88821 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:14.382577 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-830f332b-70f0-415d-bf5e-ab9752d88821 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:14.383043 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-830f332b-70f0-415d-bf5e-ab9752d88821 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:14.391993 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2a8a6279-cf61-4057-aa6d-6c4d9c5d5724 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:14.392606 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2a8a6279-cf61-4057-aa6d-6c4d9c5d5724 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:14.398567 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2a8a6279-cf61-4057-aa6d-6c4d9c5d5724 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:14.399027 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2a8a6279-cf61-4057-aa6d-6c4d9c5d5724 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:14.399796 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2a8a6279-cf61-4057-aa6d-6c4d9c5d5724 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:14.400240 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2a8a6279-cf61-4057-aa6d-6c4d9c5d5724 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:14.450689 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-830f332b-70f0-415d-bf5e-ab9752d88821 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:14.464562 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-830f332b-70f0-415d-bf5e-ab9752d88821 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1241 microversion: 2.1 time: 0.095304 Jul 18 16:53:14.466978 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 122/252] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:14 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:14.540958 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2a8a6279-cf61-4057-aa6d-6c4d9c5d5724 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:14.552931 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2a8a6279-cf61-4057-aa6d-6c4d9c5d5724 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.164826 Jul 18 16:53:14.554212 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 131/253] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:14 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:15.258640 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-18d77ccb-a668-497e-9eec-17d85f29c662 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:15.259242 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-18d77ccb-a668-497e-9eec-17d85f29c662 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:15.265401 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18d77ccb-a668-497e-9eec-17d85f29c662 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:15.265855 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18d77ccb-a668-497e-9eec-17d85f29c662 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:15.266781 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18d77ccb-a668-497e-9eec-17d85f29c662 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:15.267227 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18d77ccb-a668-497e-9eec-17d85f29c662 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:15.399003 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-18d77ccb-a668-497e-9eec-17d85f29c662 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:15.406400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-18d77ccb-a668-497e-9eec-17d85f29c662 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.151861 Jul 18 16:53:15.407586 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 123/254] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:15 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:15.483645 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fe5dd075-c7f3-40ad-a3b7-5aef86bafd05 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:15.484151 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fe5dd075-c7f3-40ad-a3b7-5aef86bafd05 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:15.486874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:15.491829 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe5dd075-c7f3-40ad-a3b7-5aef86bafd05 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:15.492282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe5dd075-c7f3-40ad-a3b7-5aef86bafd05 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:15.493125 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe5dd075-c7f3-40ad-a3b7-5aef86bafd05 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:15.493693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe5dd075-c7f3-40ad-a3b7-5aef86bafd05 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:15.557837 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fe5dd075-c7f3-40ad-a3b7-5aef86bafd05 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:15.565503 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fe5dd075-c7f3-40ad-a3b7-5aef86bafd05 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1241 microversion: 2.1 time: 0.086065 Jul 18 16:53:15.566272 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 132/255] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:15 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:15.571803 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a1bddcaa-a5df-44e6-912d-046c976366b2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:15.572412 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a1bddcaa-a5df-44e6-912d-046c976366b2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:15.574305 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:15.580281 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1bddcaa-a5df-44e6-912d-046c976366b2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:15.580725 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1bddcaa-a5df-44e6-912d-046c976366b2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:15.581557 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1bddcaa-a5df-44e6-912d-046c976366b2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:15.581987 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1bddcaa-a5df-44e6-912d-046c976366b2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:15.658480 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=18 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:15.718147 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a1bddcaa-a5df-44e6-912d-046c976366b2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:15.727166 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a1bddcaa-a5df-44e6-912d-046c976366b2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.159238 Jul 18 16:53:15.727745 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 124/256] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:15 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:16.424733 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1cfe904d-77a7-4526-9bf8-db11e8ad3b0e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:16.425395 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1cfe904d-77a7-4526-9bf8-db11e8ad3b0e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:16.431545 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cfe904d-77a7-4526-9bf8-db11e8ad3b0e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:16.432020 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cfe904d-77a7-4526-9bf8-db11e8ad3b0e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:16.432779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cfe904d-77a7-4526-9bf8-db11e8ad3b0e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:16.433251 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cfe904d-77a7-4526-9bf8-db11e8ad3b0e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:16.566611 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1cfe904d-77a7-4526-9bf8-db11e8ad3b0e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:16.574164 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1cfe904d-77a7-4526-9bf8-db11e8ad3b0e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.154426 Jul 18 16:53:16.574733 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 133/257] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:16 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:16.582496 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b3254c2f-142e-4d30-94ef-cbae715d8f43 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:16.583170 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b3254c2f-142e-4d30-94ef-cbae715d8f43 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:16.590349 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b3254c2f-142e-4d30-94ef-cbae715d8f43 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:16.590798 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b3254c2f-142e-4d30-94ef-cbae715d8f43 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:16.591559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b3254c2f-142e-4d30-94ef-cbae715d8f43 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:16.591997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b3254c2f-142e-4d30-94ef-cbae715d8f43 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:16.607198 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:16.653582 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b3254c2f-142e-4d30-94ef-cbae715d8f43 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:16.661468 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b3254c2f-142e-4d30-94ef-cbae715d8f43 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1241 microversion: 2.1 time: 0.082969 Jul 18 16:53:16.662039 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 125/258] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:16 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:16.744931 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3c1262ad-67cf-4dee-a5cd-8cf1cac2a005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:16.745566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3c1262ad-67cf-4dee-a5cd-8cf1cac2a005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:16.752031 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3c1262ad-67cf-4dee-a5cd-8cf1cac2a005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:16.752483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3c1262ad-67cf-4dee-a5cd-8cf1cac2a005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:16.753283 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3c1262ad-67cf-4dee-a5cd-8cf1cac2a005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:16.753721 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3c1262ad-67cf-4dee-a5cd-8cf1cac2a005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:16.888634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3c1262ad-67cf-4dee-a5cd-8cf1cac2a005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:16.896670 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3c1262ad-67cf-4dee-a5cd-8cf1cac2a005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.155509 Jul 18 16:53:16.897279 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 134/259] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:16 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:17.590525 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dd57063c-e7a3-4774-bd88-9d005ca52944 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:17.591139 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dd57063c-e7a3-4774-bd88-9d005ca52944 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:17.603272 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dd57063c-e7a3-4774-bd88-9d005ca52944 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:17.603723 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dd57063c-e7a3-4774-bd88-9d005ca52944 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:17.608483 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dd57063c-e7a3-4774-bd88-9d005ca52944 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:17.608483 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dd57063c-e7a3-4774-bd88-9d005ca52944 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:17.679589 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6f4ff4f5-322f-41ea-ab0b-751cdb69f3dc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:17.680926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6f4ff4f5-322f-41ea-ab0b-751cdb69f3dc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:17.687616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6f4ff4f5-322f-41ea-ab0b-751cdb69f3dc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:17.688400 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6f4ff4f5-322f-41ea-ab0b-751cdb69f3dc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:17.689577 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6f4ff4f5-322f-41ea-ab0b-751cdb69f3dc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:17.690172 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6f4ff4f5-322f-41ea-ab0b-751cdb69f3dc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:17.744900 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dd57063c-e7a3-4774-bd88-9d005ca52944 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:17.755508 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dd57063c-e7a3-4774-bd88-9d005ca52944 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.168697 Jul 18 16:53:17.756015 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 126/260] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:17 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:17.775467 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6f4ff4f5-322f-41ea-ab0b-751cdb69f3dc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:17.778931 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:17.783856 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6f4ff4f5-322f-41ea-ab0b-751cdb69f3dc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1233 microversion: 2.1 time: 0.108192 Jul 18 16:53:17.784419 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 135/261] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:17 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1233 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:17.914020 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ff33f7dd-5e33-400f-8f10-84c407fc7de0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:17.914622 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ff33f7dd-5e33-400f-8f10-84c407fc7de0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:17.920604 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff33f7dd-5e33-400f-8f10-84c407fc7de0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:17.921079 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff33f7dd-5e33-400f-8f10-84c407fc7de0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:17.921880 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff33f7dd-5e33-400f-8f10-84c407fc7de0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:17.922456 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff33f7dd-5e33-400f-8f10-84c407fc7de0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:18.055377 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ff33f7dd-5e33-400f-8f10-84c407fc7de0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:18.063686 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ff33f7dd-5e33-400f-8f10-84c407fc7de0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.152886 Jul 18 16:53:18.064320 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 127/262] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:17 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:18.773055 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8868e104-e6a1-4b25-b6ed-4f17e6c18970 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:18.773660 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8868e104-e6a1-4b25-b6ed-4f17e6c18970 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:18.781085 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8868e104-e6a1-4b25-b6ed-4f17e6c18970 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:18.781918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8868e104-e6a1-4b25-b6ed-4f17e6c18970 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:18.783428 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8868e104-e6a1-4b25-b6ed-4f17e6c18970 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:18.783986 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8868e104-e6a1-4b25-b6ed-4f17e6c18970 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:18.804611 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e8abfb8d-e518-4b82-bba0-848495f4edd5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:18.805405 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e8abfb8d-e518-4b82-bba0-848495f4edd5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:18.812101 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e8abfb8d-e518-4b82-bba0-848495f4edd5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:18.812974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e8abfb8d-e518-4b82-bba0-848495f4edd5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:18.814196 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e8abfb8d-e518-4b82-bba0-848495f4edd5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:18.814759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e8abfb8d-e518-4b82-bba0-848495f4edd5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:18.892095 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e8abfb8d-e518-4b82-bba0-848495f4edd5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:18.901410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e8abfb8d-e518-4b82-bba0-848495f4edd5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1233 microversion: 2.1 time: 0.100594 Jul 18 16:53:18.901999 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 128/263] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:18 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1233 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:18.939904 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8868e104-e6a1-4b25-b6ed-4f17e6c18970 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:18.949968 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8868e104-e6a1-4b25-b6ed-4f17e6c18970 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.181438 Jul 18 16:53:18.950634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 136/264] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:18 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:19.081774 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-52883257-1ac4-499b-911d-8b76b3281438 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:19.082387 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-52883257-1ac4-499b-911d-8b76b3281438 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:19.088737 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52883257-1ac4-499b-911d-8b76b3281438 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:19.089232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52883257-1ac4-499b-911d-8b76b3281438 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:19.090009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52883257-1ac4-499b-911d-8b76b3281438 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:19.090449 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52883257-1ac4-499b-911d-8b76b3281438 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:19.235235 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-52883257-1ac4-499b-911d-8b76b3281438 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:19.243016 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-52883257-1ac4-499b-911d-8b76b3281438 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.165924 Jul 18 16:53:19.243589 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 129/265] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:19 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:19.920485 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-32178db7-95a9-4051-85a7-d27948849fac tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:19.921032 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-32178db7-95a9-4051-85a7-d27948849fac tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:19.928555 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-32178db7-95a9-4051-85a7-d27948849fac tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:19.929030 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-32178db7-95a9-4051-85a7-d27948849fac tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:19.929806 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-32178db7-95a9-4051-85a7-d27948849fac tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:19.930250 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-32178db7-95a9-4051-85a7-d27948849fac tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:19.968744 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c0d286ab-b6f3-4845-9fcd-7ed3665bfd29 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:19.972521 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c0d286ab-b6f3-4845-9fcd-7ed3665bfd29 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:19.976759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c0d286ab-b6f3-4845-9fcd-7ed3665bfd29 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:19.977246 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c0d286ab-b6f3-4845-9fcd-7ed3665bfd29 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:19.978020 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c0d286ab-b6f3-4845-9fcd-7ed3665bfd29 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:19.978457 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c0d286ab-b6f3-4845-9fcd-7ed3665bfd29 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:19.992405 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-32178db7-95a9-4051-85a7-d27948849fac tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:19.999688 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-32178db7-95a9-4051-85a7-d27948849fac tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1233 microversion: 2.1 time: 0.083103 Jul 18 16:53:20.000305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 137/266] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:19 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1233 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:20.111968 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c0d286ab-b6f3-4845-9fcd-7ed3665bfd29 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:20.119490 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c0d286ab-b6f3-4845-9fcd-7ed3665bfd29 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.154594 Jul 18 16:53:20.120054 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 130/267] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:19 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:20.260619 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8fca03be-02a5-4aab-94a4-be0f2b0e07a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:20.261261 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8fca03be-02a5-4aab-94a4-be0f2b0e07a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:20.271299 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8fca03be-02a5-4aab-94a4-be0f2b0e07a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:20.271759 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8fca03be-02a5-4aab-94a4-be0f2b0e07a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:20.272532 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8fca03be-02a5-4aab-94a4-be0f2b0e07a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:20.272971 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8fca03be-02a5-4aab-94a4-be0f2b0e07a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:20.423055 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8fca03be-02a5-4aab-94a4-be0f2b0e07a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:20.431020 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8fca03be-02a5-4aab-94a4-be0f2b0e07a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.174115 Jul 18 16:53:20.431521 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 138/268] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:20 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:21.017175 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-400123b0-bb3d-42b9-9057-0f2c858d4661 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:21.017811 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-400123b0-bb3d-42b9-9057-0f2c858d4661 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:21.024421 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-400123b0-bb3d-42b9-9057-0f2c858d4661 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.024867 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-400123b0-bb3d-42b9-9057-0f2c858d4661 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.025653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-400123b0-bb3d-42b9-9057-0f2c858d4661 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.026089 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-400123b0-bb3d-42b9-9057-0f2c858d4661 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.091632 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-400123b0-bb3d-42b9-9057-0f2c858d4661 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:21.099551 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-400123b0-bb3d-42b9-9057-0f2c858d4661 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1233 microversion: 2.1 time: 0.086522 Jul 18 16:53:21.100123 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 131/269] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:21 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:21.136219 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-350bf88f-4e52-4193-a81e-c8f67a6909a5 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:21.136815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-350bf88f-4e52-4193-a81e-c8f67a6909a5 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:21.143126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-350bf88f-4e52-4193-a81e-c8f67a6909a5 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.143572 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-350bf88f-4e52-4193-a81e-c8f67a6909a5 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.144318 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-350bf88f-4e52-4193-a81e-c8f67a6909a5 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.144745 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-350bf88f-4e52-4193-a81e-c8f67a6909a5 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.309060 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-350bf88f-4e52-4193-a81e-c8f67a6909a5 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:21.309060 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-350bf88f-4e52-4193-a81e-c8f67a6909a5 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.160647 Jul 18 16:53:21.309060 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 139/270] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:21 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:21.448755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ecf49df9-9495-4dc8-a541-5d4bddb26f7a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:21.449498 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ecf49df9-9495-4dc8-a541-5d4bddb26f7a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:21.456765 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecf49df9-9495-4dc8-a541-5d4bddb26f7a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.457251 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecf49df9-9495-4dc8-a541-5d4bddb26f7a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.458028 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecf49df9-9495-4dc8-a541-5d4bddb26f7a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.458475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecf49df9-9495-4dc8-a541-5d4bddb26f7a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.594314 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ecf49df9-9495-4dc8-a541-5d4bddb26f7a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:21.602028 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ecf49df9-9495-4dc8-a541-5d4bddb26f7a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.157200 Jul 18 16:53:21.602599 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 132/271] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:21 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:22.117171 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-369bd237-d562-44d8-90e9-f1ebf2225efb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:22.117780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-369bd237-d562-44d8-90e9-f1ebf2225efb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:22.123842 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-369bd237-d562-44d8-90e9-f1ebf2225efb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:22.128949 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-369bd237-d562-44d8-90e9-f1ebf2225efb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:22.128949 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-369bd237-d562-44d8-90e9-f1ebf2225efb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:22.128949 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-369bd237-d562-44d8-90e9-f1ebf2225efb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:22.189171 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-369bd237-d562-44d8-90e9-f1ebf2225efb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:22.196777 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-369bd237-d562-44d8-90e9-f1ebf2225efb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1233 microversion: 2.1 time: 0.083498 Jul 18 16:53:22.197908 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 140/272] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:22 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1233 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:22.309648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c7211876-0f64-4e81-a417-7f94d17e8e69 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:22.310253 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c7211876-0f64-4e81-a417-7f94d17e8e69 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:22.317032 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c7211876-0f64-4e81-a417-7f94d17e8e69 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:22.317492 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c7211876-0f64-4e81-a417-7f94d17e8e69 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:22.318261 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c7211876-0f64-4e81-a417-7f94d17e8e69 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:22.318690 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c7211876-0f64-4e81-a417-7f94d17e8e69 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:22.445973 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c7211876-0f64-4e81-a417-7f94d17e8e69 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:22.453933 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c7211876-0f64-4e81-a417-7f94d17e8e69 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.147726 Jul 18 16:53:22.454490 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 133/273] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:22 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:22.620434 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e9bf10dd-123a-4d21-9fa5-7d654f0d4755 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:22.621062 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e9bf10dd-123a-4d21-9fa5-7d654f0d4755 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:22.628141 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e9bf10dd-123a-4d21-9fa5-7d654f0d4755 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:22.628599 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e9bf10dd-123a-4d21-9fa5-7d654f0d4755 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:22.629407 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e9bf10dd-123a-4d21-9fa5-7d654f0d4755 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:22.629848 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e9bf10dd-123a-4d21-9fa5-7d654f0d4755 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:22.967996 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e9bf10dd-123a-4d21-9fa5-7d654f0d4755 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:22.976111 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e9bf10dd-123a-4d21-9fa5-7d654f0d4755 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.359499 Jul 18 16:53:22.976679 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 141/274] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:22 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:23.214053 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6981a9dc-4bc4-46ec-a8d0-30a47fcce146 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:23.214594 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6981a9dc-4bc4-46ec-a8d0-30a47fcce146 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:23.221412 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6981a9dc-4bc4-46ec-a8d0-30a47fcce146 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:23.221867 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6981a9dc-4bc4-46ec-a8d0-30a47fcce146 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:23.222636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6981a9dc-4bc4-46ec-a8d0-30a47fcce146 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:23.223085 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6981a9dc-4bc4-46ec-a8d0-30a47fcce146 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:23.287597 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6981a9dc-4bc4-46ec-a8d0-30a47fcce146 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:23.295016 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6981a9dc-4bc4-46ec-a8d0-30a47fcce146 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1233 microversion: 2.1 time: 0.084903 Jul 18 16:53:23.295567 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 134/275] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:23 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1233 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:23.472867 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-77aed657-9469-4bec-8539-4d756b649e2c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:23.473421 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-77aed657-9469-4bec-8539-4d756b649e2c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:23.480038 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-77aed657-9469-4bec-8539-4d756b649e2c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:23.480482 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-77aed657-9469-4bec-8539-4d756b649e2c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:23.481318 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-77aed657-9469-4bec-8539-4d756b649e2c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:23.482014 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-77aed657-9469-4bec-8539-4d756b649e2c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:23.624917 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-77aed657-9469-4bec-8539-4d756b649e2c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:23.635331 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-77aed657-9469-4bec-8539-4d756b649e2c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.167445 Jul 18 16:53:23.635903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 142/276] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:23 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:23.993738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b9e7555f-f0ff-4f4b-8535-d2a722523327 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:23.994385 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b9e7555f-f0ff-4f4b-8535-d2a722523327 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:24.001790 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b9e7555f-f0ff-4f4b-8535-d2a722523327 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:24.002246 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b9e7555f-f0ff-4f4b-8535-d2a722523327 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:24.003013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b9e7555f-f0ff-4f4b-8535-d2a722523327 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:24.003453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b9e7555f-f0ff-4f4b-8535-d2a722523327 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:24.138899 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b9e7555f-f0ff-4f4b-8535-d2a722523327 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:24.147082 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b9e7555f-f0ff-4f4b-8535-d2a722523327 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.157264 Jul 18 16:53:24.147675 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 135/277] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:23 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:24.311944 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-20e1edcc-91b7-439d-a3b8-a44bbe75ea3f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:24.312557 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-20e1edcc-91b7-439d-a3b8-a44bbe75ea3f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:24.318942 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-20e1edcc-91b7-439d-a3b8-a44bbe75ea3f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:24.319401 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-20e1edcc-91b7-439d-a3b8-a44bbe75ea3f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:24.320224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-20e1edcc-91b7-439d-a3b8-a44bbe75ea3f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:24.320720 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-20e1edcc-91b7-439d-a3b8-a44bbe75ea3f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:24.382882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-20e1edcc-91b7-439d-a3b8-a44bbe75ea3f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:24.390523 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-20e1edcc-91b7-439d-a3b8-a44bbe75ea3f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1289 microversion: 2.1 time: 0.082525 Jul 18 16:53:24.391049 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 143/278] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:24 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:24.653150 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-73c5be3c-bab0-40c7-bab3-a8ba5d1684ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:24.653667 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-73c5be3c-bab0-40c7-bab3-a8ba5d1684ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:24.660473 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73c5be3c-bab0-40c7-bab3-a8ba5d1684ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:24.660918 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73c5be3c-bab0-40c7-bab3-a8ba5d1684ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:24.661730 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73c5be3c-bab0-40c7-bab3-a8ba5d1684ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:24.662441 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73c5be3c-bab0-40c7-bab3-a8ba5d1684ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:24.795203 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-73c5be3c-bab0-40c7-bab3-a8ba5d1684ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:24.802821 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-73c5be3c-bab0-40c7-bab3-a8ba5d1684ad tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.153921 Jul 18 16:53:24.803480 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 136/279] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:24 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:25.165005 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7ad03fb1-e999-4181-a2b7-8f522ebd1ce9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:25.165590 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7ad03fb1-e999-4181-a2b7-8f522ebd1ce9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:25.171821 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ad03fb1-e999-4181-a2b7-8f522ebd1ce9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:25.174626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ad03fb1-e999-4181-a2b7-8f522ebd1ce9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:25.174626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ad03fb1-e999-4181-a2b7-8f522ebd1ce9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:25.174626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ad03fb1-e999-4181-a2b7-8f522ebd1ce9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:25.329723 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7ad03fb1-e999-4181-a2b7-8f522ebd1ce9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:25.337453 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7ad03fb1-e999-4181-a2b7-8f522ebd1ce9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.176209 Jul 18 16:53:25.338019 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 144/280] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:25 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:25.407661 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9e349b59-ca69-4b93-8603-b4d14beb2ab4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:25.408253 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9e349b59-ca69-4b93-8603-b4d14beb2ab4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:25.415169 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9e349b59-ca69-4b93-8603-b4d14beb2ab4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:25.415545 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9e349b59-ca69-4b93-8603-b4d14beb2ab4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:25.416320 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9e349b59-ca69-4b93-8603-b4d14beb2ab4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:25.416866 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9e349b59-ca69-4b93-8603-b4d14beb2ab4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:25.486678 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9e349b59-ca69-4b93-8603-b4d14beb2ab4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:25.494287 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9e349b59-ca69-4b93-8603-b4d14beb2ab4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1289 microversion: 2.1 time: 0.091117 Jul 18 16:53:25.494851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 137/281] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:25 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:25.820008 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-461ac47c-c132-4c23-9451-1ef384c52210 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:25.820521 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-461ac47c-c132-4c23-9451-1ef384c52210 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:25.826743 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-461ac47c-c132-4c23-9451-1ef384c52210 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:25.827204 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-461ac47c-c132-4c23-9451-1ef384c52210 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:25.827975 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-461ac47c-c132-4c23-9451-1ef384c52210 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:25.828477 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-461ac47c-c132-4c23-9451-1ef384c52210 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:25.967216 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-461ac47c-c132-4c23-9451-1ef384c52210 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:25.975761 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-461ac47c-c132-4c23-9451-1ef384c52210 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.159545 Jul 18 16:53:25.985897 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 145/282] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:25 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:26.355095 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ffe5b854-7d56-4b07-ae89-48d6c73a54bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:26.355973 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ffe5b854-7d56-4b07-ae89-48d6c73a54bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:26.362593 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ffe5b854-7d56-4b07-ae89-48d6c73a54bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:26.363190 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ffe5b854-7d56-4b07-ae89-48d6c73a54bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:26.364047 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ffe5b854-7d56-4b07-ae89-48d6c73a54bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:26.364566 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ffe5b854-7d56-4b07-ae89-48d6c73a54bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:26.497832 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ffe5b854-7d56-4b07-ae89-48d6c73a54bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:26.506081 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ffe5b854-7d56-4b07-ae89-48d6c73a54bc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.154922 Jul 18 16:53:26.509441 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 138/283] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:26 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:26.512196 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-34c6a80b-5083-4e05-b972-217570004ea5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:26.512825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-34c6a80b-5083-4e05-b972-217570004ea5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:26.520341 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-34c6a80b-5083-4e05-b972-217570004ea5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:26.520845 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-34c6a80b-5083-4e05-b972-217570004ea5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:26.521816 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-34c6a80b-5083-4e05-b972-217570004ea5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:26.522232 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-34c6a80b-5083-4e05-b972-217570004ea5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:26.548288 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-e3f0dce8-0dd1-4c89-8a73-ecda0bee3ec2 req-e2d9de01-e5c3-483e-ad71-f65566486dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0877c3d6-87eb-4aa3-b43a-ef6d2ceac308", "name": "network-vif-plugged", "status": "completed", "tag": "53c4413d-7df9-4bcc-a395-5f1e1810a1df"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:26.556834 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-e3f0dce8-0dd1-4c89-8a73-ecda0bee3ec2 req-e2d9de01-e5c3-483e-ad71-f65566486dbc service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:26.557322 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-e3f0dce8-0dd1-4c89-8a73-ecda0bee3ec2 req-e2d9de01-e5c3-483e-ad71-f65566486dbc service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:26.572545 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-e3f0dce8-0dd1-4c89-8a73-ecda0bee3ec2 req-e2d9de01-e5c3-483e-ad71-f65566486dbc service nova] Creating event network-vif-plugged:53c4413d-7df9-4bcc-a395-5f1e1810a1df for instance 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 on hv-cinder-83754 Jul 18 16:53:26.577689 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-e3f0dce8-0dd1-4c89-8a73-ecda0bee3ec2 req-e2d9de01-e5c3-483e-ad71-f65566486dbc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033842 Jul 18 16:53:26.578281 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 139/284] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:53:26.588366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-34c6a80b-5083-4e05-b972-217570004ea5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:26.596082 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-34c6a80b-5083-4e05-b972-217570004ea5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1289 microversion: 2.1 time: 0.088167 Jul 18 16:53:26.596656 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 146/285] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:26 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:26.995286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c35c16a3-6a47-4bde-859b-3476c62fcc9f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:26.996052 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c35c16a3-6a47-4bde-859b-3476c62fcc9f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:27.004327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c35c16a3-6a47-4bde-859b-3476c62fcc9f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:27.004777 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c35c16a3-6a47-4bde-859b-3476c62fcc9f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:27.005576 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c35c16a3-6a47-4bde-859b-3476c62fcc9f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:27.006017 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c35c16a3-6a47-4bde-859b-3476c62fcc9f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:27.138208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c35c16a3-6a47-4bde-859b-3476c62fcc9f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:27.145933 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c35c16a3-6a47-4bde-859b-3476c62fcc9f tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.156288 Jul 18 16:53:27.146510 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 140/286] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:26 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:27.523169 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-362e229f-f383-4719-b5ed-223465d66243 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:27.523856 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-362e229f-f383-4719-b5ed-223465d66243 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:27.525676 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=84 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:27.530579 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-362e229f-f383-4719-b5ed-223465d66243 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:27.531027 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-362e229f-f383-4719-b5ed-223465d66243 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:27.532858 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-362e229f-f383-4719-b5ed-223465d66243 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:27.533330 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-362e229f-f383-4719-b5ed-223465d66243 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:27.618420 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e2c8eee7-13ed-456e-9c2c-45b7dc072949 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:27.619036 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e2c8eee7-13ed-456e-9c2c-45b7dc072949 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:27.626073 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e2c8eee7-13ed-456e-9c2c-45b7dc072949 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:27.626422 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e2c8eee7-13ed-456e-9c2c-45b7dc072949 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:27.627217 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e2c8eee7-13ed-456e-9c2c-45b7dc072949 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:27.627660 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e2c8eee7-13ed-456e-9c2c-45b7dc072949 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:27.678565 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-362e229f-f383-4719-b5ed-223465d66243 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:27.686165 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-362e229f-f383-4719-b5ed-223465d66243 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.166857 Jul 18 16:53:27.686733 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 147/287] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:27 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:27.695467 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e2c8eee7-13ed-456e-9c2c-45b7dc072949 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:27.702956 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e2c8eee7-13ed-456e-9c2c-45b7dc072949 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1289 microversion: 2.1 time: 0.088466 Jul 18 16:53:27.711930 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 141/288] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:27 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:28.162760 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-825ffb81-5eb5-42f3-93fa-c2a289cbfbbe tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:28.163579 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-825ffb81-5eb5-42f3-93fa-c2a289cbfbbe tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:28.170415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-825ffb81-5eb5-42f3-93fa-c2a289cbfbbe tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:28.171372 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-825ffb81-5eb5-42f3-93fa-c2a289cbfbbe tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:28.173571 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-825ffb81-5eb5-42f3-93fa-c2a289cbfbbe tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:28.174228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-825ffb81-5eb5-42f3-93fa-c2a289cbfbbe tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:28.341955 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-825ffb81-5eb5-42f3-93fa-c2a289cbfbbe tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:28.350633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-825ffb81-5eb5-42f3-93fa-c2a289cbfbbe tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.191989 Jul 18 16:53:28.351384 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 148/289] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:28 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:28.703728 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-99091de2-bc3a-409e-b377-3d68fefedae7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:28.704343 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-99091de2-bc3a-409e-b377-3d68fefedae7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:28.710997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-99091de2-bc3a-409e-b377-3d68fefedae7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:28.711522 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-99091de2-bc3a-409e-b377-3d68fefedae7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:28.712229 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-99091de2-bc3a-409e-b377-3d68fefedae7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:28.717801 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-99091de2-bc3a-409e-b377-3d68fefedae7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:28.720997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d1a730e7-c6f3-4cda-a545-6c618844b672 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:28.721652 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d1a730e7-c6f3-4cda-a545-6c618844b672 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:28.728583 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d1a730e7-c6f3-4cda-a545-6c618844b672 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:28.729169 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d1a730e7-c6f3-4cda-a545-6c618844b672 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:28.730047 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d1a730e7-c6f3-4cda-a545-6c618844b672 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:28.730550 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d1a730e7-c6f3-4cda-a545-6c618844b672 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:28.809494 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d1a730e7-c6f3-4cda-a545-6c618844b672 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:28.821319 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d1a730e7-c6f3-4cda-a545-6c618844b672 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1295 microversion: 2.1 time: 0.104494 Jul 18 16:53:28.822137 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 149/290] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:28 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1295 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:29.011887 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-99091de2-bc3a-409e-b377-3d68fefedae7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:29.014318 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:29.021282 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-99091de2-bc3a-409e-b377-3d68fefedae7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.321512 Jul 18 16:53:29.021919 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 142/291] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:28 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:29.368229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-caca07c5-f1bb-4501-8b74-44356665902a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:29.368977 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-caca07c5-f1bb-4501-8b74-44356665902a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:29.376341 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-caca07c5-f1bb-4501-8b74-44356665902a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:29.380250 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-caca07c5-f1bb-4501-8b74-44356665902a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:29.380250 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-caca07c5-f1bb-4501-8b74-44356665902a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:29.380250 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-caca07c5-f1bb-4501-8b74-44356665902a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:29.546222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-caca07c5-f1bb-4501-8b74-44356665902a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:29.546383 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-caca07c5-f1bb-4501-8b74-44356665902a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.181968 Jul 18 16:53:29.546930 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 150/292] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:29 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:29.838883 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3982a86d-8c02-4a26-a743-82743fd43d13 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:29.839529 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3982a86d-8c02-4a26-a743-82743fd43d13 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:29.846903 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3982a86d-8c02-4a26-a743-82743fd43d13 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:29.847334 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3982a86d-8c02-4a26-a743-82743fd43d13 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:29.848118 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3982a86d-8c02-4a26-a743-82743fd43d13 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:29.848604 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3982a86d-8c02-4a26-a743-82743fd43d13 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:29.990911 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3982a86d-8c02-4a26-a743-82743fd43d13 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:29.998679 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3982a86d-8c02-4a26-a743-82743fd43d13 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.163677 Jul 18 16:53:29.999248 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 143/293] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:29 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:30.037664 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1cadc0dc-9dd5-4153-af15-98746a2aba23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:30.038363 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1cadc0dc-9dd5-4153-af15-98746a2aba23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:30.044874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cadc0dc-9dd5-4153-af15-98746a2aba23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:30.045601 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cadc0dc-9dd5-4153-af15-98746a2aba23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:30.046452 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cadc0dc-9dd5-4153-af15-98746a2aba23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:30.046909 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cadc0dc-9dd5-4153-af15-98746a2aba23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:30.215363 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1cadc0dc-9dd5-4153-af15-98746a2aba23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:30.224128 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1cadc0dc-9dd5-4153-af15-98746a2aba23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.190277 Jul 18 16:53:30.224712 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 151/294] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:30 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:30.563573 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-932d7c83-3d0e-4b7d-90dd-3b952c7117f3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:30.564190 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-932d7c83-3d0e-4b7d-90dd-3b952c7117f3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:30.570668 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-932d7c83-3d0e-4b7d-90dd-3b952c7117f3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:30.571207 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-932d7c83-3d0e-4b7d-90dd-3b952c7117f3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:30.571983 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-932d7c83-3d0e-4b7d-90dd-3b952c7117f3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:30.572502 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-932d7c83-3d0e-4b7d-90dd-3b952c7117f3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:30.812737 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-932d7c83-3d0e-4b7d-90dd-3b952c7117f3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:30.823609 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-932d7c83-3d0e-4b7d-90dd-3b952c7117f3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1314 microversion: 2.1 time: 0.264024 Jul 18 16:53:30.824318 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 144/295] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:30 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:31.019455 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-53e1ab45-5275-4f68-af8c-0ae18db6f801 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:31.020253 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-53e1ab45-5275-4f68-af8c-0ae18db6f801 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:31.027033 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-53e1ab45-5275-4f68-af8c-0ae18db6f801 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:31.028061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-53e1ab45-5275-4f68-af8c-0ae18db6f801 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:31.028848 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-53e1ab45-5275-4f68-af8c-0ae18db6f801 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:31.029299 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-53e1ab45-5275-4f68-af8c-0ae18db6f801 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:31.052288 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:31.133318 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-f8d480f9-3d78-4920-b16b-8c1083fabfc0 req-9eacbb65-fa1b-49c4-ad24-e01e07d9b828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f8d5ca4-1bea-450f-8560-c07717d110e6", "tag": "9684bdcd-2157-4629-9abd-16f5ea448f39"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:31.159424 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-f8d480f9-3d78-4920-b16b-8c1083fabfc0 req-9eacbb65-fa1b-49c4-ad24-e01e07d9b828 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:31.167513 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-f8d480f9-3d78-4920-b16b-8c1083fabfc0 req-9eacbb65-fa1b-49c4-ad24-e01e07d9b828 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:31.181885 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-f8d480f9-3d78-4920-b16b-8c1083fabfc0 req-9eacbb65-fa1b-49c4-ad24-e01e07d9b828 service nova] Creating event network-changed:9684bdcd-2157-4629-9abd-16f5ea448f39 for instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 on hv-cinder-83754 Jul 18 16:53:31.187547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-f8d480f9-3d78-4920-b16b-8c1083fabfc0 req-9eacbb65-fa1b-49c4-ad24-e01e07d9b828 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058379 Jul 18 16:53:31.188567 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 145/296] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:31.234119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-53e1ab45-5275-4f68-af8c-0ae18db6f801 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:31.246514 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9dc40020-51dc-4fd5-8d32-9fb2a16b78c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:31.247656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9dc40020-51dc-4fd5-8d32-9fb2a16b78c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:31.274912 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-53e1ab45-5275-4f68-af8c-0ae18db6f801 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.259105 Jul 18 16:53:31.279400 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 152/297] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:31 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:31.280496 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9dc40020-51dc-4fd5-8d32-9fb2a16b78c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:31.282728 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9dc40020-51dc-4fd5-8d32-9fb2a16b78c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:31.284579 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9dc40020-51dc-4fd5-8d32-9fb2a16b78c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:31.285054 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9dc40020-51dc-4fd5-8d32-9fb2a16b78c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:31.421449 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9dc40020-51dc-4fd5-8d32-9fb2a16b78c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:31.429433 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9dc40020-51dc-4fd5-8d32-9fb2a16b78c4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1523 microversion: 2.1 time: 0.189961 Jul 18 16:53:31.430000 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 146/298] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:31 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:31.841126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b8a3dda2-2c22-4a0b-8bcb-38f9d69e9633 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:31.841734 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b8a3dda2-2c22-4a0b-8bcb-38f9d69e9633 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:31.849830 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b8a3dda2-2c22-4a0b-8bcb-38f9d69e9633 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:31.850490 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b8a3dda2-2c22-4a0b-8bcb-38f9d69e9633 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:31.851261 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b8a3dda2-2c22-4a0b-8bcb-38f9d69e9633 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:31.851815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b8a3dda2-2c22-4a0b-8bcb-38f9d69e9633 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:31.999900 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b8a3dda2-2c22-4a0b-8bcb-38f9d69e9633 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:32.008950 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b8a3dda2-2c22-4a0b-8bcb-38f9d69e9633 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1498 microversion: 2.1 time: 0.171571 Jul 18 16:53:32.009793 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 153/299] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:31 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1498 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:32.297724 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5d8a88d7-f8ae-4a52-b59f-2fcf633434e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:32.298639 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5d8a88d7-f8ae-4a52-b59f-2fcf633434e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:32.306057 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d8a88d7-f8ae-4a52-b59f-2fcf633434e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:32.306511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d8a88d7-f8ae-4a52-b59f-2fcf633434e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:32.307299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d8a88d7-f8ae-4a52-b59f-2fcf633434e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:32.307742 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d8a88d7-f8ae-4a52-b59f-2fcf633434e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:32.446423 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9ee3fd44-5f01-441f-a773-78e613792509 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:32.447701 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9ee3fd44-5f01-441f-a773-78e613792509 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:32.456270 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ee3fd44-5f01-441f-a773-78e613792509 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:32.457194 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ee3fd44-5f01-441f-a773-78e613792509 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:32.477460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ee3fd44-5f01-441f-a773-78e613792509 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:32.477460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ee3fd44-5f01-441f-a773-78e613792509 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:32.524161 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5d8a88d7-f8ae-4a52-b59f-2fcf633434e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:32.532642 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5d8a88d7-f8ae-4a52-b59f-2fcf633434e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.239937 Jul 18 16:53:32.543840 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 147/300] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:32 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:32.605520 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9ee3fd44-5f01-441f-a773-78e613792509 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:32.617829 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9ee3fd44-5f01-441f-a773-78e613792509 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1503 microversion: 2.1 time: 0.171022 Jul 18 16:53:32.617829 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 154/301] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:32 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:32.630383 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cb73d724-4beb-4177-84fc-0b9add6ef1d4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:32.631000 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cb73d724-4beb-4177-84fc-0b9add6ef1d4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:32.637025 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cb73d724-4beb-4177-84fc-0b9add6ef1d4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:32.637501 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cb73d724-4beb-4177-84fc-0b9add6ef1d4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:32.638267 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cb73d724-4beb-4177-84fc-0b9add6ef1d4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:32.638727 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cb73d724-4beb-4177-84fc-0b9add6ef1d4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:32.801706 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cb73d724-4beb-4177-84fc-0b9add6ef1d4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:32.812082 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cb73d724-4beb-4177-84fc-0b9add6ef1d4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1517 microversion: 2.1 time: 0.185418 Jul 18 16:53:32.813641 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 148/302] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:32 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:33.550873 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f9435825-8360-4f40-9102-2f90269265d4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:33.552389 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f9435825-8360-4f40-9102-2f90269265d4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:33.557643 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-664b5c42-3f1d-4d8c-b8eb-3d676109dc01 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:33.557643 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-664b5c42-3f1d-4d8c-b8eb-3d676109dc01 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:33.560542 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f9435825-8360-4f40-9102-2f90269265d4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:33.561159 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f9435825-8360-4f40-9102-2f90269265d4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:33.562008 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f9435825-8360-4f40-9102-2f90269265d4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:33.562537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f9435825-8360-4f40-9102-2f90269265d4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:33.571258 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-664b5c42-3f1d-4d8c-b8eb-3d676109dc01 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:33.572058 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-664b5c42-3f1d-4d8c-b8eb-3d676109dc01 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:33.572957 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-664b5c42-3f1d-4d8c-b8eb-3d676109dc01 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:33.573630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-664b5c42-3f1d-4d8c-b8eb-3d676109dc01 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:33.613032 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-664b5c42-3f1d-4d8c-b8eb-3d676109dc01 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:53:33.902094 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f9435825-8360-4f40-9102-2f90269265d4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:33.917676 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f9435825-8360-4f40-9102-2f90269265d4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.371621 Jul 18 16:53:33.919566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 155/303] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:33 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:34.131880 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-664b5c42-3f1d-4d8c-b8eb-3d676109dc01 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 204 len: 0 microversion: 2.1 time: 0.579599 Jul 18 16:53:34.132920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 149/304] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 16:53:33 2022] DELETE /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:53:34.142061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dc7b5651-ed3b-4b4c-879c-4dfe19053706 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:34.145907 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dc7b5651-ed3b-4b4c-879c-4dfe19053706 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:34.149263 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc7b5651-ed3b-4b4c-879c-4dfe19053706 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:34.149720 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc7b5651-ed3b-4b4c-879c-4dfe19053706 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:34.150492 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc7b5651-ed3b-4b4c-879c-4dfe19053706 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:34.150924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc7b5651-ed3b-4b4c-879c-4dfe19053706 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:34.293300 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dc7b5651-ed3b-4b4c-879c-4dfe19053706 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:34.300920 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dc7b5651-ed3b-4b4c-879c-4dfe19053706 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1504 microversion: 2.1 time: 0.163678 Jul 18 16:53:34.301897 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 156/305] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:34 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:34.950719 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-18e25a4a-e9bc-4779-9dd6-65a83600ada7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:34.951407 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-18e25a4a-e9bc-4779-9dd6-65a83600ada7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:34.958736 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18e25a4a-e9bc-4779-9dd6-65a83600ada7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:34.959187 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18e25a4a-e9bc-4779-9dd6-65a83600ada7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:34.959954 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18e25a4a-e9bc-4779-9dd6-65a83600ada7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:34.960387 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18e25a4a-e9bc-4779-9dd6-65a83600ada7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:35.170499 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-18e25a4a-e9bc-4779-9dd6-65a83600ada7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:35.180462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-18e25a4a-e9bc-4779-9dd6-65a83600ada7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.233951 Jul 18 16:53:35.181874 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 150/306] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:34 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:35.319698 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b2cadd70-e005-464f-82d2-0d01e3f47723 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:35.320373 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b2cadd70-e005-464f-82d2-0d01e3f47723 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:35.327694 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b2cadd70-e005-464f-82d2-0d01e3f47723 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:35.328304 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b2cadd70-e005-464f-82d2-0d01e3f47723 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:35.329186 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b2cadd70-e005-464f-82d2-0d01e3f47723 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:35.329704 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b2cadd70-e005-464f-82d2-0d01e3f47723 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:35.477235 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b2cadd70-e005-464f-82d2-0d01e3f47723 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:35.486217 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b2cadd70-e005-464f-82d2-0d01e3f47723 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1504 microversion: 2.1 time: 0.170379 Jul 18 16:53:35.486762 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 157/307] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:35 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:35.843465 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6a9b64e9-7ac8-484f-a29f-74ae19cadcec tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:35.845568 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6a9b64e9-7ac8-484f-a29f-74ae19cadcec tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:35.851996 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a9b64e9-7ac8-484f-a29f-74ae19cadcec tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:35.884328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a9b64e9-7ac8-484f-a29f-74ae19cadcec tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:35.884328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a9b64e9-7ac8-484f-a29f-74ae19cadcec tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:35.884328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a9b64e9-7ac8-484f-a29f-74ae19cadcec tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:35.884328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-6a9b64e9-7ac8-484f-a29f-74ae19cadcec tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lazy-loading 'flavor' on Instance uuid 59aa6d7f-233d-4c0e-86ef-28eaba66c858 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:53:36.199095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bf75237f-efbd-41fa-a7e2-7a5daf8c0843 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:36.200019 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bf75237f-efbd-41fa-a7e2-7a5daf8c0843 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:36.206549 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bf75237f-efbd-41fa-a7e2-7a5daf8c0843 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:36.206978 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bf75237f-efbd-41fa-a7e2-7a5daf8c0843 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:36.207760 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bf75237f-efbd-41fa-a7e2-7a5daf8c0843 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:36.208261 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bf75237f-efbd-41fa-a7e2-7a5daf8c0843 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:36.323011 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6a9b64e9-7ac8-484f-a29f-74ae19cadcec tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "POST /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858/action" status: 200 len: 32 microversion: 2.1 time: 0.483654 Jul 18 16:53:36.324436 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 151/308] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 16:53:35 2022] POST /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858/action => generated 32 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:53:36.333861 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-793a2eb4-b76f-4d76-a915-31fd43f19f0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:36.334551 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-793a2eb4-b76f-4d76-a915-31fd43f19f0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:36.341601 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-793a2eb4-b76f-4d76-a915-31fd43f19f0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:36.342042 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-793a2eb4-b76f-4d76-a915-31fd43f19f0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:36.342997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-793a2eb4-b76f-4d76-a915-31fd43f19f0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:36.343430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-793a2eb4-b76f-4d76-a915-31fd43f19f0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:36.442761 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bf75237f-efbd-41fa-a7e2-7a5daf8c0843 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:36.450992 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bf75237f-efbd-41fa-a7e2-7a5daf8c0843 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.255827 Jul 18 16:53:36.452315 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 158/309] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:36 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:36.503884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e2246297-1b9d-46f6-b54b-86d15fa7b622 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:36.504823 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e2246297-1b9d-46f6-b54b-86d15fa7b622 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:36.511637 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e2246297-1b9d-46f6-b54b-86d15fa7b622 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:36.512525 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e2246297-1b9d-46f6-b54b-86d15fa7b622 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:36.513340 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e2246297-1b9d-46f6-b54b-86d15fa7b622 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:36.513960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e2246297-1b9d-46f6-b54b-86d15fa7b622 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:36.515517 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-793a2eb4-b76f-4d76-a915-31fd43f19f0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:36.527107 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-793a2eb4-b76f-4d76-a915-31fd43f19f0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.197823 Jul 18 16:53:36.538052 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 152/310] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:36 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:36.664767 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e2246297-1b9d-46f6-b54b-86d15fa7b622 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:36.685489 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e2246297-1b9d-46f6-b54b-86d15fa7b622 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1504 microversion: 2.1 time: 0.185993 Jul 18 16:53:36.693062 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 159/311] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:36 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:37.470197 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-eb5f3e1e-a6d8-468d-83be-416acb24c3da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:37.471451 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-eb5f3e1e-a6d8-468d-83be-416acb24c3da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:37.480666 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eb5f3e1e-a6d8-468d-83be-416acb24c3da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:37.481372 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eb5f3e1e-a6d8-468d-83be-416acb24c3da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:37.482467 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eb5f3e1e-a6d8-468d-83be-416acb24c3da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:37.482917 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eb5f3e1e-a6d8-468d-83be-416acb24c3da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:37.545522 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d56e1b13-caad-4a5a-b62d-5b1970d848e5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:37.546162 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d56e1b13-caad-4a5a-b62d-5b1970d848e5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:37.556083 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d56e1b13-caad-4a5a-b62d-5b1970d848e5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:37.556217 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d56e1b13-caad-4a5a-b62d-5b1970d848e5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:37.556982 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d56e1b13-caad-4a5a-b62d-5b1970d848e5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:37.557437 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d56e1b13-caad-4a5a-b62d-5b1970d848e5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:37.635172 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-eb5f3e1e-a6d8-468d-83be-416acb24c3da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:37.644453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-eb5f3e1e-a6d8-468d-83be-416acb24c3da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.179090 Jul 18 16:53:37.645055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 153/312] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:37 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:37.703617 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7090fe07-cbef-4a8a-8f5c-ef63d9ec2584 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:37.704304 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7090fe07-cbef-4a8a-8f5c-ef63d9ec2584 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:37.711108 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7090fe07-cbef-4a8a-8f5c-ef63d9ec2584 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:37.711535 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7090fe07-cbef-4a8a-8f5c-ef63d9ec2584 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:37.712370 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7090fe07-cbef-4a8a-8f5c-ef63d9ec2584 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:37.712823 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7090fe07-cbef-4a8a-8f5c-ef63d9ec2584 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:37.787949 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d56e1b13-caad-4a5a-b62d-5b1970d848e5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:37.797874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d56e1b13-caad-4a5a-b62d-5b1970d848e5 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.255036 Jul 18 16:53:37.798143 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 160/313] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:37 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:37.884118 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7090fe07-cbef-4a8a-8f5c-ef63d9ec2584 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:37.896798 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7090fe07-cbef-4a8a-8f5c-ef63d9ec2584 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1504 microversion: 2.1 time: 0.197226 Jul 18 16:53:37.901524 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 154/314] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:37 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:38.664509 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c3255f26-a813-4e74-ac05-a660094d5e99 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:38.665499 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c3255f26-a813-4e74-ac05-a660094d5e99 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:38.673381 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3255f26-a813-4e74-ac05-a660094d5e99 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:38.673916 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3255f26-a813-4e74-ac05-a660094d5e99 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:38.674947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3255f26-a813-4e74-ac05-a660094d5e99 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:38.675482 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3255f26-a813-4e74-ac05-a660094d5e99 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:38.815884 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3ad56137-86ed-4c26-934f-1f4ec617fcfe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:38.816495 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3ad56137-86ed-4c26-934f-1f4ec617fcfe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:38.824143 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3ad56137-86ed-4c26-934f-1f4ec617fcfe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:38.824604 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3ad56137-86ed-4c26-934f-1f4ec617fcfe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:38.825422 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3ad56137-86ed-4c26-934f-1f4ec617fcfe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:38.825894 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3ad56137-86ed-4c26-934f-1f4ec617fcfe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:38.985384 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3ad56137-86ed-4c26-934f-1f4ec617fcfe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:38.993704 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3ad56137-86ed-4c26-934f-1f4ec617fcfe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.182453 Jul 18 16:53:39.004531 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 155/315] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:38 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:39.012237 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c3255f26-a813-4e74-ac05-a660094d5e99 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:39.012566 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a1d1e64d-2a76-466a-82f1-b22716bd7d8b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:39.012566 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a1d1e64d-2a76-466a-82f1-b22716bd7d8b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:39.016685 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1d1e64d-2a76-466a-82f1-b22716bd7d8b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:39.017365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1d1e64d-2a76-466a-82f1-b22716bd7d8b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:39.018330 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1d1e64d-2a76-466a-82f1-b22716bd7d8b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:39.019111 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1d1e64d-2a76-466a-82f1-b22716bd7d8b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:39.019226 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c3255f26-a813-4e74-ac05-a660094d5e99 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.360887 Jul 18 16:53:39.020249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 161/316] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:38 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:39.043721 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:39.239160 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a1d1e64d-2a76-466a-82f1-b22716bd7d8b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:39.249485 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a1d1e64d-2a76-466a-82f1-b22716bd7d8b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1504 microversion: 2.1 time: 0.243504 Jul 18 16:53:39.251500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 156/317] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:39 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:39.396059 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-4e3ad9af-d422-4a5f-82e6-29d34809bdfc req-dd3936ba-addd-424c-b91d-f14bbce8ddb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0877c3d6-87eb-4aa3-b43a-ef6d2ceac308", "name": "network-vif-deleted", "tag": "53c4413d-7df9-4bcc-a395-5f1e1810a1df"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:39.408189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-4e3ad9af-d422-4a5f-82e6-29d34809bdfc req-dd3936ba-addd-424c-b91d-f14bbce8ddb8 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:39.408671 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-4e3ad9af-d422-4a5f-82e6-29d34809bdfc req-dd3936ba-addd-424c-b91d-f14bbce8ddb8 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:39.421033 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-4e3ad9af-d422-4a5f-82e6-29d34809bdfc req-dd3936ba-addd-424c-b91d-f14bbce8ddb8 service nova] Creating event network-vif-deleted:53c4413d-7df9-4bcc-a395-5f1e1810a1df for instance 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 on hv-cinder-83754 Jul 18 16:53:39.428297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-4e3ad9af-d422-4a5f-82e6-29d34809bdfc req-dd3936ba-addd-424c-b91d-f14bbce8ddb8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039255 Jul 18 16:53:39.429386 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 162/318] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:40.013718 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2cc318ed-365e-48bb-b53a-3a5cad6d0516 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:40.016717 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2cc318ed-365e-48bb-b53a-3a5cad6d0516 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:40.023505 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2cc318ed-365e-48bb-b53a-3a5cad6d0516 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:40.024260 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2cc318ed-365e-48bb-b53a-3a5cad6d0516 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:40.025495 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2cc318ed-365e-48bb-b53a-3a5cad6d0516 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:40.026128 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2cc318ed-365e-48bb-b53a-3a5cad6d0516 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:40.036579 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5f310770-54d9-44cb-af7f-7feb1d067aff tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:40.041510 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5f310770-54d9-44cb-af7f-7feb1d067aff tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:40.044821 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f310770-54d9-44cb-af7f-7feb1d067aff tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:40.045533 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f310770-54d9-44cb-af7f-7feb1d067aff tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:40.046505 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f310770-54d9-44cb-af7f-7feb1d067aff tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:40.047190 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f310770-54d9-44cb-af7f-7feb1d067aff tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:40.177834 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2cc318ed-365e-48bb-b53a-3a5cad6d0516 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:40.189001 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2cc318ed-365e-48bb-b53a-3a5cad6d0516 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.179418 Jul 18 16:53:40.190312 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 157/319] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:40 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:40.270496 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-31eb54c9-73a8-480b-95bb-3bf221ae87dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:40.271114 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-31eb54c9-73a8-480b-95bb-3bf221ae87dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:40.277720 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-31eb54c9-73a8-480b-95bb-3bf221ae87dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:40.278175 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-31eb54c9-73a8-480b-95bb-3bf221ae87dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:40.280385 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-31eb54c9-73a8-480b-95bb-3bf221ae87dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:40.280838 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-31eb54c9-73a8-480b-95bb-3bf221ae87dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:40.308687 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5f310770-54d9-44cb-af7f-7feb1d067aff tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:40.320839 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5f310770-54d9-44cb-af7f-7feb1d067aff tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.288498 Jul 18 16:53:40.321778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 163/320] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:40 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:40.325310 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-31eb54c9-73a8-480b-95bb-3bf221ae87dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:40.325829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-31eb54c9-73a8-480b-95bb-3bf221ae87dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:40.326355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-31eb54c9-73a8-480b-95bb-3bf221ae87dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lazy-loading 'fault' on Instance uuid 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:53:40.378182 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-31eb54c9-73a8-480b-95bb-3bf221ae87dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:40.385687 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-31eb54c9-73a8-480b-95bb-3bf221ae87dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1304 microversion: 2.1 time: 0.121431 Jul 18 16:53:40.386449 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 158/321] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:40 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:41.230491 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7ad34857-49c1-47fc-ba11-27bbbbbac336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:41.230491 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7ad34857-49c1-47fc-ba11-27bbbbbac336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:41.257068 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ad34857-49c1-47fc-ba11-27bbbbbac336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:41.257517 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ad34857-49c1-47fc-ba11-27bbbbbac336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:41.258324 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ad34857-49c1-47fc-ba11-27bbbbbac336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:41.258767 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ad34857-49c1-47fc-ba11-27bbbbbac336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:41.337826 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-022368f8-d69f-4e4a-ba7f-5aab0d757464 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:41.339025 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-022368f8-d69f-4e4a-ba7f-5aab0d757464 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:41.347605 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-022368f8-d69f-4e4a-ba7f-5aab0d757464 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:41.348458 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-022368f8-d69f-4e4a-ba7f-5aab0d757464 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:41.349427 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-022368f8-d69f-4e4a-ba7f-5aab0d757464 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:41.350065 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-022368f8-d69f-4e4a-ba7f-5aab0d757464 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:41.526662 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-022368f8-d69f-4e4a-ba7f-5aab0d757464 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:41.541303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-022368f8-d69f-4e4a-ba7f-5aab0d757464 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.203864 Jul 18 16:53:41.541303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 159/322] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:41 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:41.543707 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-12df58c8-cd19-4d3a-9002-243fa78cb866 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:41.544265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-12df58c8-cd19-4d3a-9002-243fa78cb866 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:41.552937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12df58c8-cd19-4d3a-9002-243fa78cb866 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:41.553565 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12df58c8-cd19-4d3a-9002-243fa78cb866 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:41.554429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12df58c8-cd19-4d3a-9002-243fa78cb866 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:41.554948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12df58c8-cd19-4d3a-9002-243fa78cb866 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:41.558788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7ad34857-49c1-47fc-ba11-27bbbbbac336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:41.572159 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7ad34857-49c1-47fc-ba11-27bbbbbac336 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.369224 Jul 18 16:53:41.573283 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 164/323] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:41 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:41.595016 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12df58c8-cd19-4d3a-9002-243fa78cb866 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:41.595570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12df58c8-cd19-4d3a-9002-243fa78cb866 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:41.596136 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-12df58c8-cd19-4d3a-9002-243fa78cb866 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lazy-loading 'fault' on Instance uuid 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:53:41.642197 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-12df58c8-cd19-4d3a-9002-243fa78cb866 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:41.650545 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-12df58c8-cd19-4d3a-9002-243fa78cb866 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1304 microversion: 2.1 time: 0.110380 Jul 18 16:53:41.651046 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 160/324] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:41 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:42.555793 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c1461c7a-f4e8-432b-8542-fe8ad72c21f8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:42.556438 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c1461c7a-f4e8-432b-8542-fe8ad72c21f8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:42.563627 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c1461c7a-f4e8-432b-8542-fe8ad72c21f8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:42.564083 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c1461c7a-f4e8-432b-8542-fe8ad72c21f8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:42.564899 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c1461c7a-f4e8-432b-8542-fe8ad72c21f8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:42.565391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c1461c7a-f4e8-432b-8542-fe8ad72c21f8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:42.595804 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ef3d2c69-1c24-4c40-890e-74218dbb0efe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:42.596535 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ef3d2c69-1c24-4c40-890e-74218dbb0efe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:42.603820 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef3d2c69-1c24-4c40-890e-74218dbb0efe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:42.604376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef3d2c69-1c24-4c40-890e-74218dbb0efe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:42.605179 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef3d2c69-1c24-4c40-890e-74218dbb0efe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:42.605619 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef3d2c69-1c24-4c40-890e-74218dbb0efe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:42.718622 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c1461c7a-f4e8-432b-8542-fe8ad72c21f8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:42.727124 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c1461c7a-f4e8-432b-8542-fe8ad72c21f8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.175511 Jul 18 16:53:42.727765 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 165/325] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:42 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:42.737088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3f91e0c0-9b6a-47b7-bdf2-a8147334e8a0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:42.737088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3f91e0c0-9b6a-47b7-bdf2-a8147334e8a0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:42.739710 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3f91e0c0-9b6a-47b7-bdf2-a8147334e8a0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:42.740165 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3f91e0c0-9b6a-47b7-bdf2-a8147334e8a0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:42.740977 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3f91e0c0-9b6a-47b7-bdf2-a8147334e8a0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:42.741482 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3f91e0c0-9b6a-47b7-bdf2-a8147334e8a0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:42.765311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ef3d2c69-1c24-4c40-890e-74218dbb0efe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:42.773779 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ef3d2c69-1c24-4c40-890e-74218dbb0efe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.184149 Jul 18 16:53:42.774687 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 161/326] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:42 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:42.784203 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3f91e0c0-9b6a-47b7-bdf2-a8147334e8a0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:42.785407 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3f91e0c0-9b6a-47b7-bdf2-a8147334e8a0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:42.785877 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-3f91e0c0-9b6a-47b7-bdf2-a8147334e8a0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lazy-loading 'fault' on Instance uuid 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:53:42.836893 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3f91e0c0-9b6a-47b7-bdf2-a8147334e8a0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:42.847318 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3f91e0c0-9b6a-47b7-bdf2-a8147334e8a0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 200 len: 1304 microversion: 2.1 time: 0.118487 Jul 18 16:53:42.848474 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 166/327] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:42 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:43.743798 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d617aaca-b3f3-481d-b57c-973f77bf7465 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:43.747770 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d617aaca-b3f3-481d-b57c-973f77bf7465 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:43.756088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d617aaca-b3f3-481d-b57c-973f77bf7465 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:43.756477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d617aaca-b3f3-481d-b57c-973f77bf7465 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:43.757682 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d617aaca-b3f3-481d-b57c-973f77bf7465 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:43.757800 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d617aaca-b3f3-481d-b57c-973f77bf7465 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:43.791510 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-414347e5-359f-4531-b61e-cc20f64bc91a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:43.792114 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-414347e5-359f-4531-b61e-cc20f64bc91a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:43.807901 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-414347e5-359f-4531-b61e-cc20f64bc91a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:43.808612 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-414347e5-359f-4531-b61e-cc20f64bc91a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:43.809678 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-414347e5-359f-4531-b61e-cc20f64bc91a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:43.810273 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-414347e5-359f-4531-b61e-cc20f64bc91a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:43.977258 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-414347e5-359f-4531-b61e-cc20f64bc91a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:43.989954 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-414347e5-359f-4531-b61e-cc20f64bc91a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.201956 Jul 18 16:53:43.999562 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d617aaca-b3f3-481d-b57c-973f77bf7465 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:44.001413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 167/328] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:43 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:44.008875 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d617aaca-b3f3-481d-b57c-973f77bf7465 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.268963 Jul 18 16:53:44.009650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 162/329] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:43 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:44.016963 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-24aa92d1-ab4b-44ea-b2aa-de8a666d8abf tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:44.018226 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-24aa92d1-ab4b-44ea-b2aa-de8a666d8abf tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:44.034661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-24aa92d1-ab4b-44ea-b2aa-de8a666d8abf tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:44.035439 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-24aa92d1-ab4b-44ea-b2aa-de8a666d8abf tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:44.038416 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-24aa92d1-ab4b-44ea-b2aa-de8a666d8abf tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:44.039332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-24aa92d1-ab4b-44ea-b2aa-de8a666d8abf tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:44.060623 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-24aa92d1-ab4b-44ea-b2aa-de8a666d8abf tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] HTTP exception thrown: Instance 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 could not be found. Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-24aa92d1-ab4b-44ea-b2aa-de8a666d8abf tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Request method failure captured: Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 HTTP/1.1 Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y_frdE35TK00hu4pO31oDX3Bxusvh87C-SDnxUajgQ1-QNzfZP_yVHoqttC7En73kcYn8fLOofp1RuKiYjlxkol3uZHRoOytni4NvGoFq8oyHKg06Ie_aoUJpmG6nAauUe56PrsvmL_n3RoEXLwqJFawFGTnZelupXBsdwhShcGtKg Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 99ae4bdba9404be09aafe72858de5a18 Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesActionsTest-1535838224 Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 16:53:44.064519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 16:53:44.066034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_99ae4bdba9404be09aafe72858de5a18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/99ae4bdba9404be09aafe72858de5a18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/99ae4bdba9404be09aafe72858de5a18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/99ae4bdba9404be09aafe72858de5a18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:53:44.066034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesActionsTest-1535838224 Jul 18 16:53:44.066034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 99ae4bdba9404be09aafe72858de5a18 Jul 18 16:53:44.066034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesActionsTest-1535838224 Jul 18 16:53:44.066034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesActionsTest-1535838224-project Jul 18 16:53:44.066034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 16:53:44.066034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 16:53:44.066034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 6809c29bee4041c393e6773643c63c2d Jul 18 16:53:44.066034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesActionsTest-1535838224-project Jul 18 16:53:44.066034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 16:53:44.066034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 could not be found. Jul 18 16:53:44.066034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '0877c3d6-87eb-4aa3-b43a-ef6d2ceac308'} Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 could not be found. Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:53:44.066895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 could not be found. Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 could not be found. Jul 18 16:53:44.068332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:53:44.070868 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-24aa92d1-ab4b-44ea-b2aa-de8a666d8abf tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Returning 404 to user: Instance 0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:53:44.072364 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-24aa92d1-ab4b-44ea-b2aa-de8a666d8abf tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308" status: 404 len: 111 microversion: 2.1 time: 0.068625 Jul 18 16:53:44.073160 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 168/330] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:44 2022] GET /compute/v2.1/servers/0877c3d6-87eb-4aa3-b43a-ef6d2ceac308 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:53:44.252029 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1178972830", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "networks": [{"uuid": "f3eb2857-7c8b-47cb-aa97-fb86cbe95d3f"}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:44.329626 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] validate_networks() for [('f3eb2857-7c8b-47cb-aa97-fb86cbe95d3f', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:53:44.809636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:53:44.810733 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:53:44.811371 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:53:44.811939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:53:44.812505 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:53:44.824598 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:44.825082 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:44.825898 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:44.826339 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:44.855923 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Getting quotas for project 99ae4bdba9404be09aafe72858de5a18. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:53:44.861528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Getting quotas for user 6809c29bee4041c393e6773643c63c2d and project 99ae4bdba9404be09aafe72858de5a18. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:53:44.873636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:53:44.876320 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:53:44.888046 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:45.010925 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-36471c18-8d97-4807-a5d2-a0a4fcce5b08 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:45.013484 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-36471c18-8d97-4807-a5d2-a0a4fcce5b08 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:45.032205 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c4f5542b-a0d3-45ae-a92d-76929999088e tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.784279 Jul 18 16:53:45.033185 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 163/331] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:53:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:53:45.035701 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36471c18-8d97-4807-a5d2-a0a4fcce5b08 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:45.037317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36471c18-8d97-4807-a5d2-a0a4fcce5b08 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:45.039871 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36471c18-8d97-4807-a5d2-a0a4fcce5b08 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:45.044831 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36471c18-8d97-4807-a5d2-a0a4fcce5b08 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:45.045252 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-56347147-3a54-4fab-9289-4f898fe1bdd4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:45.045918 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-56347147-3a54-4fab-9289-4f898fe1bdd4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:45.094087 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-56347147-3a54-4fab-9289-4f898fe1bdd4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:45.105499 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-56347147-3a54-4fab-9289-4f898fe1bdd4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:45.107568 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-56347147-3a54-4fab-9289-4f898fe1bdd4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:45.108031 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-56347147-3a54-4fab-9289-4f898fe1bdd4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:45.366242 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-56347147-3a54-4fab-9289-4f898fe1bdd4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:45.375320 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-56347147-3a54-4fab-9289-4f898fe1bdd4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.340359 Jul 18 16:53:45.376224 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 164/332] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:45 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:45.396069 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f5396b59-4759-4f13-b5fe-c862f602bb39 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:45.396069 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f5396b59-4759-4f13-b5fe-c862f602bb39 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:45.495119 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f5396b59-4759-4f13-b5fe-c862f602bb39 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:45.504980 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f5396b59-4759-4f13-b5fe-c862f602bb39 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1214 microversion: 2.1 time: 0.127466 Jul 18 16:53:45.510363 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 165/333] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:45 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1214 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:45.536601 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-36471c18-8d97-4807-a5d2-a0a4fcce5b08 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:45.538769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-c3761ced-7be0-42cb-b11c-a300570f51d1 req-a0f4d790-531b-4f48-973f-a23c3a5deca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f8d5ca4-1bea-450f-8560-c07717d110e6", "name": "network-vif-plugged", "status": "completed", "tag": "9684bdcd-2157-4629-9abd-16f5ea448f39"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:45.549683 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c3761ced-7be0-42cb-b11c-a300570f51d1 req-a0f4d790-531b-4f48-973f-a23c3a5deca8 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:45.550425 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c3761ced-7be0-42cb-b11c-a300570f51d1 req-a0f4d790-531b-4f48-973f-a23c3a5deca8 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:45.552939 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-36471c18-8d97-4807-a5d2-a0a4fcce5b08 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.547799 Jul 18 16:53:45.563829 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 169/334] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:45 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:45.584646 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-c3761ced-7be0-42cb-b11c-a300570f51d1 req-a0f4d790-531b-4f48-973f-a23c3a5deca8 service nova] Creating event network-vif-plugged:9684bdcd-2157-4629-9abd-16f5ea448f39 for instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 on hv-cinder-83754 Jul 18 16:53:45.593147 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-c3761ced-7be0-42cb-b11c-a300570f51d1 req-a0f4d790-531b-4f48-973f-a23c3a5deca8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059540 Jul 18 16:53:45.595638 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 166/335] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:53:46.392377 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a3cfe9fd-61a9-4539-96c3-c49c14e0af6e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:46.393259 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a3cfe9fd-61a9-4539-96c3-c49c14e0af6e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:46.403643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a3cfe9fd-61a9-4539-96c3-c49c14e0af6e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:46.405160 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a3cfe9fd-61a9-4539-96c3-c49c14e0af6e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:46.407303 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a3cfe9fd-61a9-4539-96c3-c49c14e0af6e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:46.409821 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a3cfe9fd-61a9-4539-96c3-c49c14e0af6e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:46.446312 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:46.523825 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8fef2d41-a989-4af4-900f-01adc4504204 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:46.524537 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8fef2d41-a989-4af4-900f-01adc4504204 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:46.533062 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8fef2d41-a989-4af4-900f-01adc4504204 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:46.533512 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8fef2d41-a989-4af4-900f-01adc4504204 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:46.534303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8fef2d41-a989-4af4-900f-01adc4504204 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:46.535249 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8fef2d41-a989-4af4-900f-01adc4504204 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:46.615203 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8fef2d41-a989-4af4-900f-01adc4504204 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:46.622863 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8fef2d41-a989-4af4-900f-01adc4504204 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1218 microversion: 2.1 time: 0.104118 Jul 18 16:53:46.623444 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 167/336] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:46 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:46.628591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-28340fd5-2148-4140-a665-d2d745482fdb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:46.629236 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-28340fd5-2148-4140-a665-d2d745482fdb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:46.635203 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-28340fd5-2148-4140-a665-d2d745482fdb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:46.635655 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-28340fd5-2148-4140-a665-d2d745482fdb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:46.636428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-28340fd5-2148-4140-a665-d2d745482fdb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:46.636867 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-28340fd5-2148-4140-a665-d2d745482fdb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:46.649380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a3cfe9fd-61a9-4539-96c3-c49c14e0af6e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:46.657753 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a3cfe9fd-61a9-4539-96c3-c49c14e0af6e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.269565 Jul 18 16:53:46.658413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 170/337] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:46 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:46.774728 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-28340fd5-2148-4140-a665-d2d745482fdb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:46.784380 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-28340fd5-2148-4140-a665-d2d745482fdb tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.159537 Jul 18 16:53:46.784722 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 168/338] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:46 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:47.641063 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ab817824-5ecd-463a-bf68-68f2e3504af2 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:47.643078 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ab817824-5ecd-463a-bf68-68f2e3504af2 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:47.651474 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ab817824-5ecd-463a-bf68-68f2e3504af2 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:47.652138 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ab817824-5ecd-463a-bf68-68f2e3504af2 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:47.653258 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ab817824-5ecd-463a-bf68-68f2e3504af2 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:47.654332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ab817824-5ecd-463a-bf68-68f2e3504af2 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:47.677143 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4e80cc32-79af-4fd1-b818-0ee3e33c1808 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:47.678516 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4e80cc32-79af-4fd1-b818-0ee3e33c1808 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:47.689999 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e80cc32-79af-4fd1-b818-0ee3e33c1808 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:47.692115 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e80cc32-79af-4fd1-b818-0ee3e33c1808 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:47.692905 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e80cc32-79af-4fd1-b818-0ee3e33c1808 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:47.695709 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e80cc32-79af-4fd1-b818-0ee3e33c1808 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:47.861474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4e80cc32-79af-4fd1-b818-0ee3e33c1808 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:47.870824 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4e80cc32-79af-4fd1-b818-0ee3e33c1808 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.198785 Jul 18 16:53:47.872167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 169/339] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:47 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:47.877767 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-112f5d88-b52e-4135-9073-81d3009528e7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:47.878660 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-112f5d88-b52e-4135-9073-81d3009528e7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:47.886258 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-112f5d88-b52e-4135-9073-81d3009528e7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:47.886994 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-112f5d88-b52e-4135-9073-81d3009528e7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:47.887959 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-112f5d88-b52e-4135-9073-81d3009528e7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:47.888585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-112f5d88-b52e-4135-9073-81d3009528e7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:48.075133 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-112f5d88-b52e-4135-9073-81d3009528e7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:48.089860 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-112f5d88-b52e-4135-9073-81d3009528e7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.215578 Jul 18 16:53:48.091188 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 170/340] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:47 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:48.127538 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ab817824-5ecd-463a-bf68-68f2e3504af2 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:48.135570 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ab817824-5ecd-463a-bf68-68f2e3504af2 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1218 microversion: 2.1 time: 0.498294 Jul 18 16:53:48.137034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 171/341] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:47 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1218 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:48.888384 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ed1426f3-27e8-4886-a1c1-388eda594226 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:48.889045 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ed1426f3-27e8-4886-a1c1-388eda594226 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:48.895852 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ed1426f3-27e8-4886-a1c1-388eda594226 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:48.896311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ed1426f3-27e8-4886-a1c1-388eda594226 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:48.897230 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ed1426f3-27e8-4886-a1c1-388eda594226 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:48.897675 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ed1426f3-27e8-4886-a1c1-388eda594226 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.077739 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ed1426f3-27e8-4886-a1c1-388eda594226 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:49.083839 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ed1426f3-27e8-4886-a1c1-388eda594226 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1363 microversion: 2.1 time: 0.199270 Jul 18 16:53:49.084427 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 171/342] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:48 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:49.108956 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8edbdc5b-80fc-466e-840b-4b67be3a58c2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:49.110271 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8edbdc5b-80fc-466e-840b-4b67be3a58c2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:49.124378 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8edbdc5b-80fc-466e-840b-4b67be3a58c2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:49.125140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8edbdc5b-80fc-466e-840b-4b67be3a58c2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.126114 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8edbdc5b-80fc-466e-840b-4b67be3a58c2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:49.127697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8edbdc5b-80fc-466e-840b-4b67be3a58c2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.157428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-34203b0e-8880-45a4-92fc-f16d9ad49e25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:49.158583 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-34203b0e-8880-45a4-92fc-f16d9ad49e25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:49.185408 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-34203b0e-8880-45a4-92fc-f16d9ad49e25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:49.186009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-34203b0e-8880-45a4-92fc-f16d9ad49e25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.188213 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-34203b0e-8880-45a4-92fc-f16d9ad49e25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:49.188749 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-34203b0e-8880-45a4-92fc-f16d9ad49e25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.276653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-34203b0e-8880-45a4-92fc-f16d9ad49e25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:49.294682 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-34203b0e-8880-45a4-92fc-f16d9ad49e25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1266 microversion: 2.1 time: 0.143656 Jul 18 16:53:49.296564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 172/343] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:49 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:49.330810 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8edbdc5b-80fc-466e-840b-4b67be3a58c2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:49.340758 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8edbdc5b-80fc-466e-840b-4b67be3a58c2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.236205 Jul 18 16:53:49.341987 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 172/344] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:49 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:50.103375 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a7d30f6a-e50f-4cb4-abc4-af0cf0539490 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:50.103375 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a7d30f6a-e50f-4cb4-abc4-af0cf0539490 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:50.110428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a7d30f6a-e50f-4cb4-abc4-af0cf0539490 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.111132 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a7d30f6a-e50f-4cb4-abc4-af0cf0539490 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.112084 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a7d30f6a-e50f-4cb4-abc4-af0cf0539490 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.112722 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a7d30f6a-e50f-4cb4-abc4-af0cf0539490 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.315460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-45a8b148-996f-4d78-9d3c-25c10705af03 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:50.316718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-45a8b148-996f-4d78-9d3c-25c10705af03 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:50.330095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45a8b148-996f-4d78-9d3c-25c10705af03 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.330557 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45a8b148-996f-4d78-9d3c-25c10705af03 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.331353 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45a8b148-996f-4d78-9d3c-25c10705af03 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.332092 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45a8b148-996f-4d78-9d3c-25c10705af03 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.414298 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a7d30f6a-e50f-4cb4-abc4-af0cf0539490 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:50.424358 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a7d30f6a-e50f-4cb4-abc4-af0cf0539490 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1548 microversion: 2.1 time: 0.327101 Jul 18 16:53:50.431406 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 173/345] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:50 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1548 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:50.445964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-65a0089d-fd9b-47a7-adbb-5a30f8667005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:50.446774 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-65a0089d-fd9b-47a7-adbb-5a30f8667005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:50.467718 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65a0089d-fd9b-47a7-adbb-5a30f8667005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.468178 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65a0089d-fd9b-47a7-adbb-5a30f8667005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.469749 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65a0089d-fd9b-47a7-adbb-5a30f8667005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.470535 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65a0089d-fd9b-47a7-adbb-5a30f8667005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.491750 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-45a8b148-996f-4d78-9d3c-25c10705af03 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:50.520003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-45a8b148-996f-4d78-9d3c-25c10705af03 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1272 microversion: 2.1 time: 0.209540 Jul 18 16:53:50.521420 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 173/346] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:50 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:50.534681 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2251beef-7da4-4d08-9708-f1ec1bd746d5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:50.536285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2251beef-7da4-4d08-9708-f1ec1bd746d5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:50.546167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2251beef-7da4-4d08-9708-f1ec1bd746d5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.547010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2251beef-7da4-4d08-9708-f1ec1bd746d5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.548942 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2251beef-7da4-4d08-9708-f1ec1bd746d5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.550006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2251beef-7da4-4d08-9708-f1ec1bd746d5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.728581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-65a0089d-fd9b-47a7-adbb-5a30f8667005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:50.733055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:50.742015 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-65a0089d-fd9b-47a7-adbb-5a30f8667005 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.313730 Jul 18 16:53:50.742647 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 174/347] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:50 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:50.796002 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2251beef-7da4-4d08-9708-f1ec1bd746d5 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.272218 Jul 18 16:53:50.796771 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 174/348] 10.222.0.76 () {58 vars in 1274 bytes} [Mon Jul 18 16:53:50 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/os-interface => generated 284 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:51.539356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3efa914a-1a16-4efe-830d-065978f41a3b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:51.540623 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3efa914a-1a16-4efe-830d-065978f41a3b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:51.551290 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3efa914a-1a16-4efe-830d-065978f41a3b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:51.552674 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3efa914a-1a16-4efe-830d-065978f41a3b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:51.553814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3efa914a-1a16-4efe-830d-065978f41a3b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:51.554390 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3efa914a-1a16-4efe-830d-065978f41a3b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:51.573547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-879ca551-b5e0-45ec-aaa5-d1950f6f66bc tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Action: 'create', calling method: .version_select at 0x7f4af191f670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1291189408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuiI4egfooPp1bWp9IF2kfjBnpo0qXPUKtVFGgF6zI3Vh7zMCUmHZFyF287C1mygX6dCudYDxAYyUTbQVmBXsnZyb8efMTamdSPzLOnH9osr4+sIt17IlpFToANTd62EQ=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:51.595165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-879ca551-b5e0-45ec-aaa5-d1950f6f66bc tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Getting quotas for project 997c256859f2484e8465c043b3d2299d. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:53:51.600588 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-879ca551-b5e0-45ec-aaa5-d1950f6f66bc tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Getting quotas for user 4ad27549c1824d45b1d55653e2c121a8 and project 997c256859f2484e8465c043b3d2299d. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:53:51.738393 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-879ca551-b5e0-45ec-aaa5-d1950f6f66bc tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.632952 Jul 18 16:53:51.747560 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 175/349] 10.222.0.76 () {60 vars in 1158 bytes} [Mon Jul 18 16:53:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:51.769732 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b8745394-d1ce-4777-96e6-a2e0926d697d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:51.775902 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b8745394-d1ce-4777-96e6-a2e0926d697d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:51.781397 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b8745394-d1ce-4777-96e6-a2e0926d697d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:51.784552 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b8745394-d1ce-4777-96e6-a2e0926d697d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:51.786569 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b8745394-d1ce-4777-96e6-a2e0926d697d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:51.787422 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b8745394-d1ce-4777-96e6-a2e0926d697d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:51.790013 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3efa914a-1a16-4efe-830d-065978f41a3b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:51.815572 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3efa914a-1a16-4efe-830d-065978f41a3b tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1272 microversion: 2.1 time: 0.280936 Jul 18 16:53:51.816483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 175/350] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:51 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:52.023481 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b8745394-d1ce-4777-96e6-a2e0926d697d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:52.038853 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b8745394-d1ce-4777-96e6-a2e0926d697d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.280412 Jul 18 16:53:52.045234 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 176/351] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:51 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:52.832792 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-981cef1b-196f-477d-ac4e-701a21b30c84 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:52.833306 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-981cef1b-196f-477d-ac4e-701a21b30c84 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:52.839914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-981cef1b-196f-477d-ac4e-701a21b30c84 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:52.840410 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-981cef1b-196f-477d-ac4e-701a21b30c84 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:52.841463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-981cef1b-196f-477d-ac4e-701a21b30c84 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:52.842105 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-981cef1b-196f-477d-ac4e-701a21b30c84 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:53.066432 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a50ab4d9-e319-49f7-9fa1-21529bf1e5c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:53.073300 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a50ab4d9-e319-49f7-9fa1-21529bf1e5c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:53.078691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a50ab4d9-e319-49f7-9fa1-21529bf1e5c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:53.079152 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a50ab4d9-e319-49f7-9fa1-21529bf1e5c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:53.079946 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a50ab4d9-e319-49f7-9fa1-21529bf1e5c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:53.080389 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a50ab4d9-e319-49f7-9fa1-21529bf1e5c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:53.167685 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-981cef1b-196f-477d-ac4e-701a21b30c84 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:53.175603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-981cef1b-196f-477d-ac4e-701a21b30c84 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1314 microversion: 2.1 time: 0.347967 Jul 18 16:53:53.185127 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 176/352] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:52 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:53.364476 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a50ab4d9-e319-49f7-9fa1-21529bf1e5c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:53.381846 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a50ab4d9-e319-49f7-9fa1-21529bf1e5c1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.321766 Jul 18 16:53:53.382656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 177/353] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:53 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:53.754472 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-dafc8c1b-112a-4485-b730-315c2f03b9e6 req-3a8269b1-21e1-4282-aaa0-cf8435f150da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f8d5ca4-1bea-450f-8560-c07717d110e6", "tag": "9684bdcd-2157-4629-9abd-16f5ea448f39"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:53.774405 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-dafc8c1b-112a-4485-b730-315c2f03b9e6 req-3a8269b1-21e1-4282-aaa0-cf8435f150da service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:53.775055 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-dafc8c1b-112a-4485-b730-315c2f03b9e6 req-3a8269b1-21e1-4282-aaa0-cf8435f150da service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:53.793961 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-dafc8c1b-112a-4485-b730-315c2f03b9e6 req-3a8269b1-21e1-4282-aaa0-cf8435f150da service nova] Creating event network-changed:9684bdcd-2157-4629-9abd-16f5ea448f39 for instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 on hv-cinder-83754 Jul 18 16:53:53.801713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-dafc8c1b-112a-4485-b730-315c2f03b9e6 req-3a8269b1-21e1-4282-aaa0-cf8435f150da service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053481 Jul 18 16:53:53.803637 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 177/354] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:54.209571 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3b5bcc3a-849a-4cc8-8e18-c9ce2b56e88c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:54.210964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3b5bcc3a-849a-4cc8-8e18-c9ce2b56e88c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:54.220779 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3b5bcc3a-849a-4cc8-8e18-c9ce2b56e88c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:54.221968 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3b5bcc3a-849a-4cc8-8e18-c9ce2b56e88c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:54.222970 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3b5bcc3a-849a-4cc8-8e18-c9ce2b56e88c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:54.225403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3b5bcc3a-849a-4cc8-8e18-c9ce2b56e88c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:54.400228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c58c60d5-f66d-4c3b-a3e4-fff2a965e694 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:54.401109 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c58c60d5-f66d-4c3b-a3e4-fff2a965e694 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:54.417325 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c58c60d5-f66d-4c3b-a3e4-fff2a965e694 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:54.418078 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c58c60d5-f66d-4c3b-a3e4-fff2a965e694 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:54.419061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c58c60d5-f66d-4c3b-a3e4-fff2a965e694 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:54.419686 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c58c60d5-f66d-4c3b-a3e4-fff2a965e694 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:54.615200 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3b5bcc3a-849a-4cc8-8e18-c9ce2b56e88c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:54.631880 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3b5bcc3a-849a-4cc8-8e18-c9ce2b56e88c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1314 microversion: 2.1 time: 0.441457 Jul 18 16:53:54.643442 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 178/355] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:54 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:54.643782 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c58c60d5-f66d-4c3b-a3e4-fff2a965e694 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:54.665370 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c58c60d5-f66d-4c3b-a3e4-fff2a965e694 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.259815 Jul 18 16:53:54.665370 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 178/356] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:54 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:55.650451 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-635819a4-5c2c-4e70-b979-ea78dbe009dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:55.651037 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-635819a4-5c2c-4e70-b979-ea78dbe009dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:55.652962 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:55.664495 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-635819a4-5c2c-4e70-b979-ea78dbe009dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:55.665283 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-635819a4-5c2c-4e70-b979-ea78dbe009dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:55.666671 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-635819a4-5c2c-4e70-b979-ea78dbe009dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:55.667017 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-635819a4-5c2c-4e70-b979-ea78dbe009dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:55.676898 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-30e269b4-38e0-402b-9d8a-82f2f857fcae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:55.677575 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-30e269b4-38e0-402b-9d8a-82f2f857fcae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:55.684056 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-30e269b4-38e0-402b-9d8a-82f2f857fcae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:55.684797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-30e269b4-38e0-402b-9d8a-82f2f857fcae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:55.685855 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-30e269b4-38e0-402b-9d8a-82f2f857fcae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:55.686527 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-30e269b4-38e0-402b-9d8a-82f2f857fcae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:56.032340 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-635819a4-5c2c-4e70-b979-ea78dbe009dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:56.047841 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-635819a4-5c2c-4e70-b979-ea78dbe009dc tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1314 microversion: 2.1 time: 0.398502 Jul 18 16:53:56.050538 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 179/357] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:55 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:56.059599 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-3e78865f-3c73-4fda-b5e5-81c5abb591ed req-60314ac4-51a5-4751-9fce-d807c34a152a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3", "tag": "570d471d-1b06-4556-ba8c-f891a1d697de"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:56.071587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-3e78865f-3c73-4fda-b5e5-81c5abb591ed req-60314ac4-51a5-4751-9fce-d807c34a152a service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:56.072371 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-3e78865f-3c73-4fda-b5e5-81c5abb591ed req-60314ac4-51a5-4751-9fce-d807c34a152a service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:56.090019 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-3e78865f-3c73-4fda-b5e5-81c5abb591ed req-60314ac4-51a5-4751-9fce-d807c34a152a service nova] Creating event network-changed:570d471d-1b06-4556-ba8c-f891a1d697de for instance 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 on hv-cinder-83754 Jul 18 16:53:56.097388 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-3e78865f-3c73-4fda-b5e5-81c5abb591ed req-60314ac4-51a5-4751-9fce-d807c34a152a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045249 Jul 18 16:53:56.098364 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 180/358] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:56.411047 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-30e269b4-38e0-402b-9d8a-82f2f857fcae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:56.419138 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-30e269b4-38e0-402b-9d8a-82f2f857fcae tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.746136 Jul 18 16:53:56.429266 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 179/359] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:55 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:57.071224 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-26378ac8-bbd5-426d-8746-d942bb07979a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:57.072785 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-26378ac8-bbd5-426d-8746-d942bb07979a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:57.090476 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-26378ac8-bbd5-426d-8746-d942bb07979a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:57.090942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-26378ac8-bbd5-426d-8746-d942bb07979a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:57.091738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-26378ac8-bbd5-426d-8746-d942bb07979a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:57.092184 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-26378ac8-bbd5-426d-8746-d942bb07979a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:57.347477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-26378ac8-bbd5-426d-8746-d942bb07979a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:57.356332 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-26378ac8-bbd5-426d-8746-d942bb07979a tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1314 microversion: 2.1 time: 0.291699 Jul 18 16:53:57.357989 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 181/360] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:57 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:57.435685 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-09a2264a-3273-4c55-8aec-07af59cee45a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:57.436826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-09a2264a-3273-4c55-8aec-07af59cee45a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:57.452689 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09a2264a-3273-4c55-8aec-07af59cee45a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:57.454187 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09a2264a-3273-4c55-8aec-07af59cee45a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:57.454571 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09a2264a-3273-4c55-8aec-07af59cee45a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:57.455218 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09a2264a-3273-4c55-8aec-07af59cee45a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:57.729537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-09a2264a-3273-4c55-8aec-07af59cee45a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:57.739168 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-09a2264a-3273-4c55-8aec-07af59cee45a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.307076 Jul 18 16:53:57.740533 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 180/361] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:57 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:58.373916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6e39541e-542b-464e-8ddb-af3580218ec0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:58.375943 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6e39541e-542b-464e-8ddb-af3580218ec0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:58.394668 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e39541e-542b-464e-8ddb-af3580218ec0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:58.395454 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e39541e-542b-464e-8ddb-af3580218ec0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:58.396600 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e39541e-542b-464e-8ddb-af3580218ec0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:58.397069 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e39541e-542b-464e-8ddb-af3580218ec0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:58.556573 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6e39541e-542b-464e-8ddb-af3580218ec0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:58.564476 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6e39541e-542b-464e-8ddb-af3580218ec0 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1314 microversion: 2.1 time: 0.194385 Jul 18 16:53:58.565336 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 182/362] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:58 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:58.758341 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-663b77c4-751f-4f89-bba7-65d6e49f2303 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:58.760991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-663b77c4-751f-4f89-bba7-65d6e49f2303 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:58.762563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=70 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:58.767144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-663b77c4-751f-4f89-bba7-65d6e49f2303 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:58.767640 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-663b77c4-751f-4f89-bba7-65d6e49f2303 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:58.768430 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-663b77c4-751f-4f89-bba7-65d6e49f2303 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:58.769099 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-663b77c4-751f-4f89-bba7-65d6e49f2303 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:59.029443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-663b77c4-751f-4f89-bba7-65d6e49f2303 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:59.057302 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-663b77c4-751f-4f89-bba7-65d6e49f2303 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.292109 Jul 18 16:53:59.057302 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 181/363] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:58 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:59.582321 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-31bb8901-2418-4fb6-b8ce-81f09adaa034 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:59.583001 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-31bb8901-2418-4fb6-b8ce-81f09adaa034 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:59.589665 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-31bb8901-2418-4fb6-b8ce-81f09adaa034 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:59.590118 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-31bb8901-2418-4fb6-b8ce-81f09adaa034 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:59.590899 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-31bb8901-2418-4fb6-b8ce-81f09adaa034 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:59.591339 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-31bb8901-2418-4fb6-b8ce-81f09adaa034 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:59.745290 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-31bb8901-2418-4fb6-b8ce-81f09adaa034 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:59.756716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-31bb8901-2418-4fb6-b8ce-81f09adaa034 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1314 microversion: 2.1 time: 0.178218 Jul 18 16:53:59.766500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 183/364] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:59 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:00.065971 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8060916f-acd7-4def-b1ad-3b5246ef87e6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:00.067346 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8060916f-acd7-4def-b1ad-3b5246ef87e6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:00.076535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8060916f-acd7-4def-b1ad-3b5246ef87e6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:00.077497 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8060916f-acd7-4def-b1ad-3b5246ef87e6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:00.078892 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8060916f-acd7-4def-b1ad-3b5246ef87e6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:00.083702 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8060916f-acd7-4def-b1ad-3b5246ef87e6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:00.351688 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8060916f-acd7-4def-b1ad-3b5246ef87e6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:00.362682 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8060916f-acd7-4def-b1ad-3b5246ef87e6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.302470 Jul 18 16:54:00.363465 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 182/365] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:00 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:00.795693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-44d417d9-e295-4b48-8017-cd605ec1a962 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:00.796316 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-44d417d9-e295-4b48-8017-cd605ec1a962 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:00.805514 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44d417d9-e295-4b48-8017-cd605ec1a962 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:00.805990 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44d417d9-e295-4b48-8017-cd605ec1a962 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:00.810202 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44d417d9-e295-4b48-8017-cd605ec1a962 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:00.810808 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44d417d9-e295-4b48-8017-cd605ec1a962 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:01.020985 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-44d417d9-e295-4b48-8017-cd605ec1a962 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:01.033312 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-44d417d9-e295-4b48-8017-cd605ec1a962 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1314 microversion: 2.1 time: 0.254718 Jul 18 16:54:01.036997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 184/366] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:00 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:01.382854 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-85252b62-7f62-47cb-b02a-bb2de2644cca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:01.384145 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-85252b62-7f62-47cb-b02a-bb2de2644cca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:01.399669 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-85252b62-7f62-47cb-b02a-bb2de2644cca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:01.400147 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-85252b62-7f62-47cb-b02a-bb2de2644cca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:01.400994 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-85252b62-7f62-47cb-b02a-bb2de2644cca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:01.404525 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-85252b62-7f62-47cb-b02a-bb2de2644cca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:01.690600 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-85252b62-7f62-47cb-b02a-bb2de2644cca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:01.699216 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-85252b62-7f62-47cb-b02a-bb2de2644cca tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1503 microversion: 2.1 time: 0.322216 Jul 18 16:54:01.700167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 183/367] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:01 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:01.717447 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fc6b717f-a464-4e31-be96-f28f1b05b841 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a581e3a4-1638-4f03-835c-b9fe31e95d48"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:01.718520 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fc6b717f-a464-4e31-be96-f28f1b05b841 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:01.720655 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=12 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:01.725837 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc6b717f-a464-4e31-be96-f28f1b05b841 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:01.726297 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc6b717f-a464-4e31-be96-f28f1b05b841 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:01.727079 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc6b717f-a464-4e31-be96-f28f1b05b841 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:01.727701 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc6b717f-a464-4e31-be96-f28f1b05b841 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:01.757428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-fc6b717f-a464-4e31-be96-f28f1b05b841 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] HTTP exception thrown: Cannot 'attach_volume' instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 while it is in vm_state rescued Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fc6b717f-a464-4e31-be96-f28f1b05b841 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Request method failure captured: Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: POST /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858/os-volume_attachments HTTP/1.1 Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 74 Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y-TiVRFIxQUFS3o-vF1tU9Gsir476hfPwg6-9QY-ekQJczP403moh-x5hK5fdr7Kyenyms_fsEbsImWQwwhBO-dS1lqDFJndVpqEGo5Vn-47C8Aj-o3gFI_Qx_JhbRvmzfNos5WqnfrA286SqwZvQAoPFHOJXCA-yaId_liYvjAawc Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 2e5e262f0ed548ee8a4450d0d4806667 Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:54:01.759355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:54:01.760746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:54:01.760746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:54:01.760746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 2e5e262f0ed548ee8a4450d0d4806667 Jul 18 16:54:01.760746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:54:01.760746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-ServerRescueNegativeTestJSON-1412367741-project Jul 18 16:54:01.760746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:54:01.760746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:54:01.760746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 4d27db5cdd9e453dbd93b862db694309 Jul 18 16:54:01.760746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1412367741-project Jul 18 16:54:01.760746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Jul 18 16:54:01.760746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {"volumeAttachment": {"volumeId": "a581e3a4-1638-4f03-835c-b9fe31e95d48"}} Jul 18 16:54:01.760746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Cannot 'attach_volume' instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 while it is in vm_state rescued Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'server_id': '59aa6d7f-233d-4c0e-86ef-28eaba66c858', 'body': {'volumeAttachment': {'volumeId': 'a581e3a4-1638-4f03-835c-b9fe31e95d48'}}} Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:54:01.761786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 while it is in vm_state rescued Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:54:01.762964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:54:01.764055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:54:01.764055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:54:01.764055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 while it is in vm_state rescued Jul 18 16:54:01.764055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:54:01.764055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fc6b717f-a464-4e31-be96-f28f1b05b841 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Returning 409 to user: Cannot 'attach_volume' instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 while it is in vm_state rescued {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:54:01.764055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fc6b717f-a464-4e31-be96-f28f1b05b841 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "POST /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047633 Jul 18 16:54:01.765307 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 185/368] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 16:54:01 2022] POST /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 16:54:01.771281 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-475b3cf8-8788-4eb6-841a-3988b7491248 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:01.771936 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-475b3cf8-8788-4eb6-841a-3988b7491248 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:01.781106 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-475b3cf8-8788-4eb6-841a-3988b7491248 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:01.781558 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-475b3cf8-8788-4eb6-841a-3988b7491248 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:01.784358 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-475b3cf8-8788-4eb6-841a-3988b7491248 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:01.784839 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-475b3cf8-8788-4eb6-841a-3988b7491248 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:02.029392 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-475b3cf8-8788-4eb6-841a-3988b7491248 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "POST /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858/action" status: 202 len: 0 microversion: 2.1 time: 0.262080 Jul 18 16:54:02.030194 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 184/369] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 16:54:01 2022] POST /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:54:02.047196 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-914edfb7-4816-4e48-afc2-98574eec4460 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:02.047992 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-914edfb7-4816-4e48-afc2-98574eec4460 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:02.051174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bc1e358b-7d64-471d-8ac2-be497d516e57 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:02.051881 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bc1e358b-7d64-471d-8ac2-be497d516e57 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:02.054887 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-914edfb7-4816-4e48-afc2-98574eec4460 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:02.055343 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-914edfb7-4816-4e48-afc2-98574eec4460 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:02.056117 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-914edfb7-4816-4e48-afc2-98574eec4460 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:02.056553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-914edfb7-4816-4e48-afc2-98574eec4460 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:02.058566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bc1e358b-7d64-471d-8ac2-be497d516e57 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:02.063767 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bc1e358b-7d64-471d-8ac2-be497d516e57 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:02.064758 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bc1e358b-7d64-471d-8ac2-be497d516e57 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:02.065416 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bc1e358b-7d64-471d-8ac2-be497d516e57 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:02.252713 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-914edfb7-4816-4e48-afc2-98574eec4460 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:02.270830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-914edfb7-4816-4e48-afc2-98574eec4460 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1511 microversion: 2.1 time: 0.229112 Jul 18 16:54:02.271986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 186/370] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:02 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1511 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:02.329531 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bc1e358b-7d64-471d-8ac2-be497d516e57 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:02.337914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bc1e358b-7d64-471d-8ac2-be497d516e57 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1314 microversion: 2.1 time: 0.291177 Jul 18 16:54:02.339008 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 185/371] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:02 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:03.290755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-18b9de48-c381-41fe-9653-e354f0408f9e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:03.291381 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-18b9de48-c381-41fe-9653-e354f0408f9e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:03.299456 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18b9de48-c381-41fe-9653-e354f0408f9e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:03.300163 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18b9de48-c381-41fe-9653-e354f0408f9e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:03.301634 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18b9de48-c381-41fe-9653-e354f0408f9e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:03.302241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18b9de48-c381-41fe-9653-e354f0408f9e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:03.366834 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e05effed-b128-4d5b-a567-16efd943e0c6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:03.367452 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e05effed-b128-4d5b-a567-16efd943e0c6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:03.387316 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e05effed-b128-4d5b-a567-16efd943e0c6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:03.387767 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e05effed-b128-4d5b-a567-16efd943e0c6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:03.391283 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e05effed-b128-4d5b-a567-16efd943e0c6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:03.392002 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e05effed-b128-4d5b-a567-16efd943e0c6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:03.470599 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-18b9de48-c381-41fe-9653-e354f0408f9e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:03.485118 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-18b9de48-c381-41fe-9653-e354f0408f9e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1511 microversion: 2.1 time: 0.197794 Jul 18 16:54:03.485901 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 187/372] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:03 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:03.685924 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-8f15bb2e-2986-4138-8a4c-dee06d104629 req-84eb1c03-a77f-417d-9663-f10c23366b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3", "name": "network-vif-plugged", "status": "completed", "tag": "570d471d-1b06-4556-ba8c-f891a1d697de"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:03.697381 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-8f15bb2e-2986-4138-8a4c-dee06d104629 req-84eb1c03-a77f-417d-9663-f10c23366b93 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:03.697381 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-8f15bb2e-2986-4138-8a4c-dee06d104629 req-84eb1c03-a77f-417d-9663-f10c23366b93 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:03.711690 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-8f15bb2e-2986-4138-8a4c-dee06d104629 req-84eb1c03-a77f-417d-9663-f10c23366b93 service nova] Creating event network-vif-plugged:570d471d-1b06-4556-ba8c-f891a1d697de for instance 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 on hv-cinder-83754 Jul 18 16:54:03.717586 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-8f15bb2e-2986-4138-8a4c-dee06d104629 req-84eb1c03-a77f-417d-9663-f10c23366b93 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036879 Jul 18 16:54:03.718411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 188/373] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:54:03.816901 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e05effed-b128-4d5b-a567-16efd943e0c6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:03.820952 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:03.826136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e05effed-b128-4d5b-a567-16efd943e0c6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1314 microversion: 2.1 time: 0.475831 Jul 18 16:54:03.827028 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 186/374] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:03 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:04.504839 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5843306d-1abe-40d6-a42a-0fc27774ccf7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:04.505669 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5843306d-1abe-40d6-a42a-0fc27774ccf7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:04.515001 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5843306d-1abe-40d6-a42a-0fc27774ccf7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.515588 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5843306d-1abe-40d6-a42a-0fc27774ccf7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:04.517302 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5843306d-1abe-40d6-a42a-0fc27774ccf7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.517826 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5843306d-1abe-40d6-a42a-0fc27774ccf7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:04.676175 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5843306d-1abe-40d6-a42a-0fc27774ccf7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:04.685456 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5843306d-1abe-40d6-a42a-0fc27774ccf7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1511 microversion: 2.1 time: 0.185404 Jul 18 16:54:04.686279 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 189/375] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:04 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1511 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:04.845515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cb42fec2-eb63-48b8-bd6a-1555582ce663 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:04.847244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cb42fec2-eb63-48b8-bd6a-1555582ce663 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:04.855887 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cb42fec2-eb63-48b8-bd6a-1555582ce663 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.856631 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cb42fec2-eb63-48b8-bd6a-1555582ce663 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:04.858054 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cb42fec2-eb63-48b8-bd6a-1555582ce663 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.858840 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cb42fec2-eb63-48b8-bd6a-1555582ce663 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:05.121644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cb42fec2-eb63-48b8-bd6a-1555582ce663 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:05.139049 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cb42fec2-eb63-48b8-bd6a-1555582ce663 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1314 microversion: 2.1 time: 0.298362 Jul 18 16:54:05.148093 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 187/376] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:04 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:05.705085 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2ddc9ab6-9516-438b-858d-73102dfa88e0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:05.706355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2ddc9ab6-9516-438b-858d-73102dfa88e0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:05.718128 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ddc9ab6-9516-438b-858d-73102dfa88e0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:05.718678 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ddc9ab6-9516-438b-858d-73102dfa88e0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:05.719505 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ddc9ab6-9516-438b-858d-73102dfa88e0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:05.719954 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ddc9ab6-9516-438b-858d-73102dfa88e0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:05.876197 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2ddc9ab6-9516-438b-858d-73102dfa88e0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:05.891246 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2ddc9ab6-9516-438b-858d-73102dfa88e0 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1511 microversion: 2.1 time: 0.191665 Jul 18 16:54:05.892039 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 190/377] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:05 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:06.155999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c3280567-c622-4bc6-ab8a-89435d11e6c1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:06.157277 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c3280567-c622-4bc6-ab8a-89435d11e6c1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:06.165766 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3280567-c622-4bc6-ab8a-89435d11e6c1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:06.166938 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3280567-c622-4bc6-ab8a-89435d11e6c1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:06.168365 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3280567-c622-4bc6-ab8a-89435d11e6c1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:06.169096 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3280567-c622-4bc6-ab8a-89435d11e6c1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:06.460859 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c3280567-c622-4bc6-ab8a-89435d11e6c1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:06.474639 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c3280567-c622-4bc6-ab8a-89435d11e6c1 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1314 microversion: 2.1 time: 0.322570 Jul 18 16:54:06.475214 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 188/378] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:06 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:06.911238 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fe1ab4aa-3d1b-4f37-8909-2dfa3a111133 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:06.911887 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fe1ab4aa-3d1b-4f37-8909-2dfa3a111133 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:06.918513 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe1ab4aa-3d1b-4f37-8909-2dfa3a111133 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:06.919096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe1ab4aa-3d1b-4f37-8909-2dfa3a111133 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:06.919720 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe1ab4aa-3d1b-4f37-8909-2dfa3a111133 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:06.920150 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe1ab4aa-3d1b-4f37-8909-2dfa3a111133 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:07.095358 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fe1ab4aa-3d1b-4f37-8909-2dfa3a111133 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:07.104807 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fe1ab4aa-3d1b-4f37-8909-2dfa3a111133 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1517 microversion: 2.1 time: 0.199606 Jul 18 16:54:07.124199 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 191/379] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:06 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1517 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:07.495173 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d7017c48-1fdf-421b-be49-fc139d8427bb tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:07.495943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d7017c48-1fdf-421b-be49-fc139d8427bb tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:07.503894 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d7017c48-1fdf-421b-be49-fc139d8427bb tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:07.504676 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d7017c48-1fdf-421b-be49-fc139d8427bb tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:07.505584 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d7017c48-1fdf-421b-be49-fc139d8427bb tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:07.506224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d7017c48-1fdf-421b-be49-fc139d8427bb tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:07.749622 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d7017c48-1fdf-421b-be49-fc139d8427bb tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:07.758137 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d7017c48-1fdf-421b-be49-fc139d8427bb tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1314 microversion: 2.1 time: 0.268965 Jul 18 16:54:07.759381 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 189/380] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:07 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:08.776151 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e44dff8a-1e8c-425d-b3a7-29dbd33debb6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:08.777962 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e44dff8a-1e8c-425d-b3a7-29dbd33debb6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:08.785302 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e44dff8a-1e8c-425d-b3a7-29dbd33debb6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:08.786056 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e44dff8a-1e8c-425d-b3a7-29dbd33debb6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:08.787020 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e44dff8a-1e8c-425d-b3a7-29dbd33debb6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:08.787496 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e44dff8a-1e8c-425d-b3a7-29dbd33debb6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:08.963928 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e44dff8a-1e8c-425d-b3a7-29dbd33debb6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:08.977544 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e44dff8a-1e8c-425d-b3a7-29dbd33debb6 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1314 microversion: 2.1 time: 0.205397 Jul 18 16:54:08.978134 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 192/381] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:08 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:09.995693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-11dfe955-79fc-429d-8828-feacc51cc5a3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:09.996862 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-11dfe955-79fc-429d-8828-feacc51cc5a3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:10.004793 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11dfe955-79fc-429d-8828-feacc51cc5a3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:10.005373 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11dfe955-79fc-429d-8828-feacc51cc5a3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:10.006222 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11dfe955-79fc-429d-8828-feacc51cc5a3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:10.006729 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11dfe955-79fc-429d-8828-feacc51cc5a3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:10.154164 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-11dfe955-79fc-429d-8828-feacc51cc5a3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:10.163800 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-11dfe955-79fc-429d-8828-feacc51cc5a3 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1499 microversion: 2.1 time: 0.172196 Jul 18 16:54:10.164483 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 193/382] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:09 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1499 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:10.170830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-890369a6-296c-47f6-a46b-3e9a4cfae527 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Action: 'create', calling method: .version_select at 0x7f4af19ad0d0>, body: {"keypair": {"name": "tempest-keypair-1147791083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYlidn27Q8X2nXDOjr+WGT1OSoITVfBIN4ZH7hCAmZubdO0x1IpXQp7Rk3Cijsk5SZss/X64OmO8zNz1G0Ld6fNh6bBvFFVtgdOrBBZwyEru3ef2rnRCKPmzUQeprmhTA=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:10.186614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-890369a6-296c-47f6-a46b-3e9a4cfae527 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Getting quotas for project 2e5e262f0ed548ee8a4450d0d4806667. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:54:10.189752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8b7e28b5-5969-4267-ade2-593811b81e68 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Action: 'create', calling method: .version_select at 0x7f4af1f70b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1556813197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ45wULH455R3fphw7QbWAaMzCItJlUubwKPvql+mmnYYyyVyCsFPgliy1wpMJdXvvPvcUsPFd9nJeE5QgYHnLvwkqiyZIG0lDd681RwU2G46UUqazLRYu2gu8c0q3dYFQ=="}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:10.191927 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-890369a6-296c-47f6-a46b-3e9a4cfae527 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Getting quotas for user 4d27db5cdd9e453dbd93b862db694309 and project 2e5e262f0ed548ee8a4450d0d4806667. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:54:10.226070 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-8b7e28b5-5969-4267-ade2-593811b81e68 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Getting quotas for project 46abecf729dd426f9ffc02cee5d67150. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:54:10.232731 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-8b7e28b5-5969-4267-ade2-593811b81e68 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Getting quotas for user 9011730621194d0e8165de381177bd2e and project 46abecf729dd426f9ffc02cee5d67150. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:54:10.294703 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-890369a6-296c-47f6-a46b-3e9a4cfae527 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128704 Jul 18 16:54:10.295336 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 194/383] 10.222.0.76 () {60 vars in 1158 bytes} [Mon Jul 18 16:54:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:10.395549 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8b7e28b5-5969-4267-ade2-593811b81e68 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.438804 Jul 18 16:54:10.396466 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 190/384] 10.222.0.76 () {60 vars in 1158 bytes} [Mon Jul 18 16:54:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:12.237568 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d93964a6-98f9-44d6-8c0b-3fdc5262038d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:12.238104 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d93964a6-98f9-44d6-8c0b-3fdc5262038d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:12.244929 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d93964a6-98f9-44d6-8c0b-3fdc5262038d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:12.245523 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d93964a6-98f9-44d6-8c0b-3fdc5262038d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:12.248949 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d93964a6-98f9-44d6-8c0b-3fdc5262038d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:12.248949 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d93964a6-98f9-44d6-8c0b-3fdc5262038d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:12.251875 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:12.289268 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d93964a6-98f9-44d6-8c0b-3fdc5262038d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:54:12.815112 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d93964a6-98f9-44d6-8c0b-3fdc5262038d tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 204 len: 0 microversion: 2.1 time: 0.582445 Jul 18 16:54:12.816583 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 195/385] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 16:54:12 2022] DELETE /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:54:12.837199 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6408e213-d2c6-47cd-ab6b-6f916fa54f9c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:12.837829 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6408e213-d2c6-47cd-ab6b-6f916fa54f9c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:12.850460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6408e213-d2c6-47cd-ab6b-6f916fa54f9c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:12.853134 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6408e213-d2c6-47cd-ab6b-6f916fa54f9c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:12.854085 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6408e213-d2c6-47cd-ab6b-6f916fa54f9c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:12.866448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6408e213-d2c6-47cd-ab6b-6f916fa54f9c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:13.074652 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6408e213-d2c6-47cd-ab6b-6f916fa54f9c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:13.085604 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6408e213-d2c6-47cd-ab6b-6f916fa54f9c tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1505 microversion: 2.1 time: 0.253851 Jul 18 16:54:13.095825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 191/386] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:12 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:13.545130 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-731535607", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dcc16841-fc4e-4a98-994d-a1d78c3a3330"}], "security_groups": [{"name": "tempest-securitygroup--2027965189"}], "key_name": "tempest-keypair-1147791083", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:13.667618 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] validate_networks() for [('dcc16841-fc4e-4a98-994d-a1d78c3a3330', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:54:14.106036 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ea6740e6-21db-4df2-aa09-1f2e4c3c1b25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:14.106656 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ea6740e6-21db-4df2-aa09-1f2e4c3c1b25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:14.114951 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea6740e6-21db-4df2-aa09-1f2e4c3c1b25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:14.115532 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea6740e6-21db-4df2-aa09-1f2e4c3c1b25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:14.116381 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea6740e6-21db-4df2-aa09-1f2e4c3c1b25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:14.117149 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea6740e6-21db-4df2-aa09-1f2e4c3c1b25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:14.148462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:54:14.148906 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:54:14.149514 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:54:14.149929 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:54:14.150358 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:54:14.153034 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:14.163914 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:14.164687 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:14.165543 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:14.165986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:14.186038 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Getting quotas for project 2e5e262f0ed548ee8a4450d0d4806667. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:54:14.191192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Getting quotas for user 4d27db5cdd9e453dbd93b862db694309 and project 2e5e262f0ed548ee8a4450d0d4806667. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:54:14.204085 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:54:14.206548 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:54:14.279264 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ea6740e6-21db-4df2-aa09-1f2e4c3c1b25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:14.287697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ea6740e6-21db-4df2-aa09-1f2e4c3c1b25 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1505 microversion: 2.1 time: 0.186976 Jul 18 16:54:14.297676 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 192/387] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:14 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:14.362473 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d6b2f2ee-54d5-4e9a-b9ca-9423a299bb1a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.822117 Jul 18 16:54:14.363289 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 196/388] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:54:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:54:14.378831 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3b2ffa9e-2113-48bd-9173-364a726e9025 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:14.379471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3b2ffa9e-2113-48bd-9173-364a726e9025 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:14.445724 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3b2ffa9e-2113-48bd-9173-364a726e9025 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:14.456220 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3b2ffa9e-2113-48bd-9173-364a726e9025 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1245 microversion: 2.1 time: 0.082931 Jul 18 16:54:14.456220 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 193/389] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:14 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:15.305378 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-95b0ea2e-5d7a-4724-9f26-acabff2ce340 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:15.306067 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-95b0ea2e-5d7a-4724-9f26-acabff2ce340 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:15.313367 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-95b0ea2e-5d7a-4724-9f26-acabff2ce340 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:15.313861 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-95b0ea2e-5d7a-4724-9f26-acabff2ce340 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:15.314863 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-95b0ea2e-5d7a-4724-9f26-acabff2ce340 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:15.315307 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-95b0ea2e-5d7a-4724-9f26-acabff2ce340 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:15.454907 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-95b0ea2e-5d7a-4724-9f26-acabff2ce340 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:15.463079 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-95b0ea2e-5d7a-4724-9f26-acabff2ce340 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1505 microversion: 2.1 time: 0.162225 Jul 18 16:54:15.463657 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 197/390] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:15 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:15.474135 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cf93bcb1-5e5b-497e-b48b-360f3d2bdc5a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:15.474823 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cf93bcb1-5e5b-497e-b48b-360f3d2bdc5a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:15.481541 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cf93bcb1-5e5b-497e-b48b-360f3d2bdc5a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:15.482237 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cf93bcb1-5e5b-497e-b48b-360f3d2bdc5a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:15.483315 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cf93bcb1-5e5b-497e-b48b-360f3d2bdc5a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:15.484016 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cf93bcb1-5e5b-497e-b48b-360f3d2bdc5a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:15.619402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cf93bcb1-5e5b-497e-b48b-360f3d2bdc5a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:15.624647 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cf93bcb1-5e5b-497e-b48b-360f3d2bdc5a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1249 microversion: 2.1 time: 0.155680 Jul 18 16:54:15.625667 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 194/391] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:15 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1249 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:15.654753 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-c6f59a58-605c-4e4f-b21f-ea2ab28c4f25 req-eded1f2a-ba2c-4c7e-b2ea-86c93f8e24de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3", "name": "network-vif-deleted", "tag": "570d471d-1b06-4556-ba8c-f891a1d697de"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:15.666394 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c6f59a58-605c-4e4f-b21f-ea2ab28c4f25 req-eded1f2a-ba2c-4c7e-b2ea-86c93f8e24de service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:15.666854 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c6f59a58-605c-4e4f-b21f-ea2ab28c4f25 req-eded1f2a-ba2c-4c7e-b2ea-86c93f8e24de service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:15.680809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-c6f59a58-605c-4e4f-b21f-ea2ab28c4f25 req-eded1f2a-ba2c-4c7e-b2ea-86c93f8e24de service nova] Creating event network-vif-deleted:570d471d-1b06-4556-ba8c-f891a1d697de for instance 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 on hv-cinder-83754 Jul 18 16:54:15.686306 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-c6f59a58-605c-4e4f-b21f-ea2ab28c4f25 req-eded1f2a-ba2c-4c7e-b2ea-86c93f8e24de service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035136 Jul 18 16:54:15.686720 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 198/392] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:16.481217 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7981bd29-9a76-4fe9-a5c0-3cb24c52e6a8 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:16.481934 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7981bd29-9a76-4fe9-a5c0-3cb24c52e6a8 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:16.489646 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7981bd29-9a76-4fe9-a5c0-3cb24c52e6a8 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.490092 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7981bd29-9a76-4fe9-a5c0-3cb24c52e6a8 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.490872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7981bd29-9a76-4fe9-a5c0-3cb24c52e6a8 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.491309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7981bd29-9a76-4fe9-a5c0-3cb24c52e6a8 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.522686 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7981bd29-9a76-4fe9-a5c0-3cb24c52e6a8 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.523131 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7981bd29-9a76-4fe9-a5c0-3cb24c52e6a8 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.523580 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-7981bd29-9a76-4fe9-a5c0-3cb24c52e6a8 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lazy-loading 'fault' on Instance uuid 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:54:16.568591 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7981bd29-9a76-4fe9-a5c0-3cb24c52e6a8 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6809c29bee4041c393e6773643c63c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ae4bdba9404be09aafe72858de5a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:16.577529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7981bd29-9a76-4fe9-a5c0-3cb24c52e6a8 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 200 len: 1304 microversion: 2.1 time: 0.100492 Jul 18 16:54:16.578577 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 195/393] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:16 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:16.643478 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-507081ac-4f79-4ade-8949-ba3bb2d92045 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:16.644265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-507081ac-4f79-4ade-8949-ba3bb2d92045 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:16.650634 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-507081ac-4f79-4ade-8949-ba3bb2d92045 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.651080 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-507081ac-4f79-4ade-8949-ba3bb2d92045 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.651853 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-507081ac-4f79-4ade-8949-ba3bb2d92045 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.652289 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-507081ac-4f79-4ade-8949-ba3bb2d92045 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.717483 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-507081ac-4f79-4ade-8949-ba3bb2d92045 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:16.726222 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-507081ac-4f79-4ade-8949-ba3bb2d92045 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1297 microversion: 2.1 time: 0.087648 Jul 18 16:54:16.726779 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 199/394] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:16 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:17.597523 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2fefae77-b229-4996-9097-d6e74a508700 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:17.598140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2fefae77-b229-4996-9097-d6e74a508700 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] [instance: 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:17.604921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2fefae77-b229-4996-9097-d6e74a508700 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:17.605363 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2fefae77-b229-4996-9097-d6e74a508700 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:17.606173 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2fefae77-b229-4996-9097-d6e74a508700 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:17.606613 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2fefae77-b229-4996-9097-d6e74a508700 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:17.621484 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-2fefae77-b229-4996-9097-d6e74a508700 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] HTTP exception thrown: Instance 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 could not be found. Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2fefae77-b229-4996-9097-d6e74a508700 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Request method failure captured: Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 HTTP/1.1 Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y_frdE35TK00hu4pO31oDX3Bxusvh87C-SDnxUajgQ1-QNzfZP_yVHoqttC7En73kcYn8fLOofp1RuKiYjlxkol3uZHRoOytni4NvGoFq8oyHKg06Ie_aoUJpmG6nAauUe56PrsvmL_n3RoEXLwqJFawFGTnZelupXBsdwhShcGtKg Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 99ae4bdba9404be09aafe72858de5a18 Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesActionsTest-1535838224 Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 16:54:17.626328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 16:54:17.627825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_99ae4bdba9404be09aafe72858de5a18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/99ae4bdba9404be09aafe72858de5a18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/99ae4bdba9404be09aafe72858de5a18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/99ae4bdba9404be09aafe72858de5a18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:54:17.627825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesActionsTest-1535838224 Jul 18 16:54:17.627825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 99ae4bdba9404be09aafe72858de5a18 Jul 18 16:54:17.627825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesActionsTest-1535838224 Jul 18 16:54:17.627825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesActionsTest-1535838224-project Jul 18 16:54:17.627825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 16:54:17.627825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 16:54:17.627825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 6809c29bee4041c393e6773643c63c2d Jul 18 16:54:17.627825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesActionsTest-1535838224-project Jul 18 16:54:17.627825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 16:54:17.627825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 could not be found. Jul 18 16:54:17.627825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3'} Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 could not be found. Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:54:17.629380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 could not be found. Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 could not be found. Jul 18 16:54:17.630582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:54:17.631752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2fefae77-b229-4996-9097-d6e74a508700 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] Returning 404 to user: Instance 9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:54:17.631752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2fefae77-b229-4996-9097-d6e74a508700 tempest-VolumesActionsTest-1535838224 tempest-VolumesActionsTest-1535838224-project] 10.222.0.76 "GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3" status: 404 len: 111 microversion: 2.1 time: 0.031650 Jul 18 16:54:17.631752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 196/395] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:17 2022] GET /compute/v2.1/servers/9f3dc5fe-f9ee-48e8-9d60-1dc73e22a1e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:54:17.744231 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-826bb85b-d8bb-49f9-889d-666a27a47dee tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:17.744948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-826bb85b-d8bb-49f9-889d-666a27a47dee tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:17.751999 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-826bb85b-d8bb-49f9-889d-666a27a47dee tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:17.758667 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-826bb85b-d8bb-49f9-889d-666a27a47dee tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:17.758667 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-826bb85b-d8bb-49f9-889d-666a27a47dee tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:17.758667 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-826bb85b-d8bb-49f9-889d-666a27a47dee tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:17.818175 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-826bb85b-d8bb-49f9-889d-666a27a47dee tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:17.831382 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-826bb85b-d8bb-49f9-889d-666a27a47dee tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1303 microversion: 2.1 time: 0.085965 Jul 18 16:54:17.831382 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 200/396] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:17 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1303 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:18.852620 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-aed37a8b-35ad-4ebb-8603-fa9d71e40a27 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:18.853341 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-aed37a8b-35ad-4ebb-8603-fa9d71e40a27 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:18.864648 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aed37a8b-35ad-4ebb-8603-fa9d71e40a27 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:18.865133 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aed37a8b-35ad-4ebb-8603-fa9d71e40a27 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:18.865931 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aed37a8b-35ad-4ebb-8603-fa9d71e40a27 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:18.866372 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aed37a8b-35ad-4ebb-8603-fa9d71e40a27 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:19.113070 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-3fd178ed-cbf6-421e-a208-523f24dde0c2 req-3d0d4d13-e4cc-4ca2-9eeb-b0c6dad2478b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10246df8-f808-47a9-947f-af78a2fd64c9", "tag": "4df48297-725a-439e-bb47-a2b832df545f"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:19.127321 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-3fd178ed-cbf6-421e-a208-523f24dde0c2 req-3d0d4d13-e4cc-4ca2-9eeb-b0c6dad2478b service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:19.128362 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-3fd178ed-cbf6-421e-a208-523f24dde0c2 req-3d0d4d13-e4cc-4ca2-9eeb-b0c6dad2478b service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:19.148693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-aed37a8b-35ad-4ebb-8603-fa9d71e40a27 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:19.151944 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-3fd178ed-cbf6-421e-a208-523f24dde0c2 req-3d0d4d13-e4cc-4ca2-9eeb-b0c6dad2478b service nova] Creating event network-changed:4df48297-725a-439e-bb47-a2b832df545f for instance 10246df8-f808-47a9-947f-af78a2fd64c9 on hv-cinder-83754 Jul 18 16:54:19.159952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-3fd178ed-cbf6-421e-a208-523f24dde0c2 req-3d0d4d13-e4cc-4ca2-9eeb-b0c6dad2478b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056694 Jul 18 16:54:19.160429 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-aed37a8b-35ad-4ebb-8603-fa9d71e40a27 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.312779 Jul 18 16:54:19.162328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 201/397] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:54:19.166948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 197/398] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:18 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:20.179684 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-014359fd-0d72-47a4-b920-0e0d645e8fb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:20.180384 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-014359fd-0d72-47a4-b920-0e0d645e8fb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:20.188305 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-014359fd-0d72-47a4-b920-0e0d645e8fb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:20.188579 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-014359fd-0d72-47a4-b920-0e0d645e8fb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:20.189345 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-014359fd-0d72-47a4-b920-0e0d645e8fb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:20.189982 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-014359fd-0d72-47a4-b920-0e0d645e8fb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:20.334649 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-014359fd-0d72-47a4-b920-0e0d645e8fb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:20.343061 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-014359fd-0d72-47a4-b920-0e0d645e8fb7 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.167950 Jul 18 16:54:20.344721 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 202/399] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:20 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:21.362091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2a7f04fa-480c-4ceb-a81b-32b4b6d29e09 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:21.362723 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2a7f04fa-480c-4ceb-a81b-32b4b6d29e09 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:21.368810 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2a7f04fa-480c-4ceb-a81b-32b4b6d29e09 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:21.369294 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2a7f04fa-480c-4ceb-a81b-32b4b6d29e09 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:21.370052 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2a7f04fa-480c-4ceb-a81b-32b4b6d29e09 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:21.370496 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2a7f04fa-480c-4ceb-a81b-32b4b6d29e09 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:21.509441 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2a7f04fa-480c-4ceb-a81b-32b4b6d29e09 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:21.519124 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2a7f04fa-480c-4ceb-a81b-32b4b6d29e09 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.161708 Jul 18 16:54:21.519695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 198/400] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:21 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:22.537459 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0f49826a-7e70-4ba3-b181-25e79ef159ef tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:22.538072 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0f49826a-7e70-4ba3-b181-25e79ef159ef tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:22.544743 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0f49826a-7e70-4ba3-b181-25e79ef159ef tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:22.545254 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0f49826a-7e70-4ba3-b181-25e79ef159ef tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:22.546011 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0f49826a-7e70-4ba3-b181-25e79ef159ef tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:22.546442 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0f49826a-7e70-4ba3-b181-25e79ef159ef tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:22.678391 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0f49826a-7e70-4ba3-b181-25e79ef159ef tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:22.686064 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0f49826a-7e70-4ba3-b181-25e79ef159ef tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.152284 Jul 18 16:54:22.686752 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 203/401] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:22 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:23.703735 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-edbb5935-b117-4aa0-9ca6-b3c5839096ab tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:23.704451 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-edbb5935-b117-4aa0-9ca6-b3c5839096ab tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:23.711498 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-edbb5935-b117-4aa0-9ca6-b3c5839096ab tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:23.711997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-edbb5935-b117-4aa0-9ca6-b3c5839096ab tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:23.712754 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-edbb5935-b117-4aa0-9ca6-b3c5839096ab tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:23.713350 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-edbb5935-b117-4aa0-9ca6-b3c5839096ab tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:23.847399 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-edbb5935-b117-4aa0-9ca6-b3c5839096ab tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:23.855075 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-edbb5935-b117-4aa0-9ca6-b3c5839096ab tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.155066 Jul 18 16:54:23.855590 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 199/402] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:23 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:24.873741 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8f777b53-0bd9-4d2c-a47c-d5b12aba9bf6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:24.874290 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8f777b53-0bd9-4d2c-a47c-d5b12aba9bf6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:24.877177 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:24.877834 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=10 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:24.882649 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f777b53-0bd9-4d2c-a47c-d5b12aba9bf6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:24.889134 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f777b53-0bd9-4d2c-a47c-d5b12aba9bf6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:24.889134 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f777b53-0bd9-4d2c-a47c-d5b12aba9bf6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:24.889134 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f777b53-0bd9-4d2c-a47c-d5b12aba9bf6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:25.024485 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8f777b53-0bd9-4d2c-a47c-d5b12aba9bf6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:25.032930 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8f777b53-0bd9-4d2c-a47c-d5b12aba9bf6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.163043 Jul 18 16:54:25.033549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 204/403] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:24 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:26.049861 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-86e55714-f046-4c3c-ad18-a366b7989e3e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:26.050505 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-86e55714-f046-4c3c-ad18-a366b7989e3e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:26.052402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=6 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:26.057474 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86e55714-f046-4c3c-ad18-a366b7989e3e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:26.057897 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86e55714-f046-4c3c-ad18-a366b7989e3e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:26.058661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86e55714-f046-4c3c-ad18-a366b7989e3e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:26.059093 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86e55714-f046-4c3c-ad18-a366b7989e3e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:26.200803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-86e55714-f046-4c3c-ad18-a366b7989e3e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:26.210220 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-86e55714-f046-4c3c-ad18-a366b7989e3e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.164660 Jul 18 16:54:26.210799 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 200/404] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:26 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:27.228264 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-04a8f9ad-6963-4671-918e-c0abcbd53083 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:27.228864 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-04a8f9ad-6963-4671-918e-c0abcbd53083 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:27.236574 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04a8f9ad-6963-4671-918e-c0abcbd53083 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:27.237077 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04a8f9ad-6963-4671-918e-c0abcbd53083 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:27.237852 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04a8f9ad-6963-4671-918e-c0abcbd53083 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:27.238285 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04a8f9ad-6963-4671-918e-c0abcbd53083 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:27.382559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-04a8f9ad-6963-4671-918e-c0abcbd53083 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:27.388165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-04a8f9ad-6963-4671-918e-c0abcbd53083 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.163672 Jul 18 16:54:27.388762 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 205/405] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:27 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:28.405304 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f121e611-bc44-4994-9578-b1a5a4134577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:28.405942 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f121e611-bc44-4994-9578-b1a5a4134577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:28.412028 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f121e611-bc44-4994-9578-b1a5a4134577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:28.413662 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f121e611-bc44-4994-9578-b1a5a4134577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:28.413662 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f121e611-bc44-4994-9578-b1a5a4134577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:28.413923 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f121e611-bc44-4994-9578-b1a5a4134577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:28.545983 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f121e611-bc44-4994-9578-b1a5a4134577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:28.554552 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f121e611-bc44-4994-9578-b1a5a4134577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.153034 Jul 18 16:54:28.555135 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 201/406] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:28 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:29.574700 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-98b8e45f-0593-453e-bd1d-b444f9f44ad2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:29.575226 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-98b8e45f-0593-453e-bd1d-b444f9f44ad2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:29.582529 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98b8e45f-0593-453e-bd1d-b444f9f44ad2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:29.583007 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98b8e45f-0593-453e-bd1d-b444f9f44ad2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:29.583830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98b8e45f-0593-453e-bd1d-b444f9f44ad2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:29.584297 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98b8e45f-0593-453e-bd1d-b444f9f44ad2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:29.728273 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-98b8e45f-0593-453e-bd1d-b444f9f44ad2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:29.737324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-98b8e45f-0593-453e-bd1d-b444f9f44ad2 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.166669 Jul 18 16:54:29.737916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 206/407] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:29 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:30.756237 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-412b9ddb-f543-4fb2-ba14-1cbee584b5bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:30.756832 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-412b9ddb-f543-4fb2-ba14-1cbee584b5bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:30.760100 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:30.763669 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-412b9ddb-f543-4fb2-ba14-1cbee584b5bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:30.772356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-412b9ddb-f543-4fb2-ba14-1cbee584b5bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:30.772356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-412b9ddb-f543-4fb2-ba14-1cbee584b5bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:30.772356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-412b9ddb-f543-4fb2-ba14-1cbee584b5bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:30.908341 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-412b9ddb-f543-4fb2-ba14-1cbee584b5bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:30.916199 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-412b9ddb-f543-4fb2-ba14-1cbee584b5bd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.163793 Jul 18 16:54:30.916776 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 202/408] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:30 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:31.934168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-623d02ed-04f3-484a-9ea7-34a4743a7110 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:31.934769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-623d02ed-04f3-484a-9ea7-34a4743a7110 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:31.942793 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-623d02ed-04f3-484a-9ea7-34a4743a7110 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:31.943204 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-623d02ed-04f3-484a-9ea7-34a4743a7110 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:31.943978 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-623d02ed-04f3-484a-9ea7-34a4743a7110 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:31.944410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-623d02ed-04f3-484a-9ea7-34a4743a7110 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:32.143986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-623d02ed-04f3-484a-9ea7-34a4743a7110 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:32.157239 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-623d02ed-04f3-484a-9ea7-34a4743a7110 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.226318 Jul 18 16:54:32.164915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 207/409] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:31 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:33.178413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-945c305d-acc6-4667-923a-b4f2968cfb0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:33.187731 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-945c305d-acc6-4667-923a-b4f2968cfb0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:33.187731 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-945c305d-acc6-4667-923a-b4f2968cfb0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:33.187731 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-945c305d-acc6-4667-923a-b4f2968cfb0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:33.188388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-945c305d-acc6-4667-923a-b4f2968cfb0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:33.188838 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-945c305d-acc6-4667-923a-b4f2968cfb0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:33.370027 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-945c305d-acc6-4667-923a-b4f2968cfb0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:33.374097 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-945c305d-acc6-4667-923a-b4f2968cfb0b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.199946 Jul 18 16:54:33.384898 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 203/410] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:33 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:33.672021 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2074305941", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1291189408", "security_groups": [{"name": "tempest-secgroup-smoke-806392402"}], "block_device_mapping_v2": [{"uuid": "4ba1ffb6-3c10-4722-9cbb-67e918a93340", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ed716b42-439d-44c6-b097-74d923cb2bde"}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:33.816088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] validate_networks() for [('ed716b42-439d-44c6-b097-74d923cb2bde', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:54:34.240883 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:54:34.241476 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:54:34.242062 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:54:34.242585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:54:34.243005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:54:34.252660 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:34.253399 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:34.254327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:34.254960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:34.273975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Getting quotas for project 997c256859f2484e8465c043b3d2299d. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:54:34.278892 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Getting quotas for user 4ad27549c1824d45b1d55653e2c121a8 and project 997c256859f2484e8465c043b3d2299d. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:54:34.340019 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:54:34.340019 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4ba1ffb6-3c10-4722-9cbb-67e918a93340',volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:54:34.392366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7064a72c-5363-4bc4-9850-03a238afc360 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:34.392994 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7064a72c-5363-4bc4-9850-03a238afc360 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:34.398997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7064a72c-5363-4bc4-9850-03a238afc360 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:34.399511 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7064a72c-5363-4bc4-9850-03a238afc360 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:34.400228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7064a72c-5363-4bc4-9850-03a238afc360 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:34.400670 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7064a72c-5363-4bc4-9850-03a238afc360 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:34.566633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7064a72c-5363-4bc4-9850-03a238afc360 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:34.581986 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7064a72c-5363-4bc4-9850-03a238afc360 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.193793 Jul 18 16:54:34.599538 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 204/411] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:34 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:34.847580 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1cb0b416-f6a2-47e5-94f9-bc8481a2d738 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.179670 Jul 18 16:54:34.849504 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 208/412] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:54:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 16:54:34.862454 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0c029650-2f4f-4790-93b6-43a891897ac3 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:34.863083 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0c029650-2f4f-4790-93b6-43a891897ac3 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:34.942546 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0c029650-2f4f-4790-93b6-43a891897ac3 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:34.950785 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0c029650-2f4f-4790-93b6-43a891897ac3 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1095 microversion: 2.1 time: 0.093922 Jul 18 16:54:34.953285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 205/413] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:34 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1095 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:35.602309 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-58fc52a9-5ba9-4c12-879c-2052e61f8c4c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:35.602924 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-58fc52a9-5ba9-4c12-879c-2052e61f8c4c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:35.610301 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-58fc52a9-5ba9-4c12-879c-2052e61f8c4c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:35.610761 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-58fc52a9-5ba9-4c12-879c-2052e61f8c4c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:35.611527 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-58fc52a9-5ba9-4c12-879c-2052e61f8c4c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:35.611964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-58fc52a9-5ba9-4c12-879c-2052e61f8c4c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:35.778211 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-58fc52a9-5ba9-4c12-879c-2052e61f8c4c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:35.803991 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-58fc52a9-5ba9-4c12-879c-2052e61f8c4c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.205593 Jul 18 16:54:35.811862 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 209/414] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:35 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:35.968789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4dd8c3de-7d9c-480f-aca7-7ffb537b43b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:35.969541 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4dd8c3de-7d9c-480f-aca7-7ffb537b43b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:36.028349 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4dd8c3de-7d9c-480f-aca7-7ffb537b43b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:36.039163 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4dd8c3de-7d9c-480f-aca7-7ffb537b43b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1095 microversion: 2.1 time: 0.074492 Jul 18 16:54:36.040592 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 206/415] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:35 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:36.825840 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-141acf39-c12e-4b97-a7f3-7a999ead68b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:36.829679 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-141acf39-c12e-4b97-a7f3-7a999ead68b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:36.833902 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-141acf39-c12e-4b97-a7f3-7a999ead68b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:36.834356 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-141acf39-c12e-4b97-a7f3-7a999ead68b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:36.835329 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-141acf39-c12e-4b97-a7f3-7a999ead68b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:36.835929 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-141acf39-c12e-4b97-a7f3-7a999ead68b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:36.994264 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-141acf39-c12e-4b97-a7f3-7a999ead68b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:37.002886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-141acf39-c12e-4b97-a7f3-7a999ead68b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.180867 Jul 18 16:54:37.003476 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 210/416] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:36 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:37.058782 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-086e4b64-3a55-400d-bf5d-199fe11238bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:37.059384 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-086e4b64-3a55-400d-bf5d-199fe11238bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:37.067206 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-086e4b64-3a55-400d-bf5d-199fe11238bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:37.067654 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-086e4b64-3a55-400d-bf5d-199fe11238bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:37.068458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-086e4b64-3a55-400d-bf5d-199fe11238bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:37.068952 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-086e4b64-3a55-400d-bf5d-199fe11238bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:37.073500 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=95 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:37.167698 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-086e4b64-3a55-400d-bf5d-199fe11238bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:37.177275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-086e4b64-3a55-400d-bf5d-199fe11238bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1193 microversion: 2.1 time: 0.122037 Jul 18 16:54:37.177413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 207/417] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:37 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1193 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:38.021735 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8789f910-bd30-4ba1-84f5-a89a313a8f2c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:38.022393 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8789f910-bd30-4ba1-84f5-a89a313a8f2c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:38.038568 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8789f910-bd30-4ba1-84f5-a89a313a8f2c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:38.039051 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8789f910-bd30-4ba1-84f5-a89a313a8f2c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:38.039882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8789f910-bd30-4ba1-84f5-a89a313a8f2c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:38.040346 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8789f910-bd30-4ba1-84f5-a89a313a8f2c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:38.195105 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-caac4476-846d-4d38-881e-8c983f93bcd4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:38.196618 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-caac4476-846d-4d38-881e-8c983f93bcd4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:38.210884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-caac4476-846d-4d38-881e-8c983f93bcd4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:38.212333 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-caac4476-846d-4d38-881e-8c983f93bcd4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:38.213904 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-caac4476-846d-4d38-881e-8c983f93bcd4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:38.216945 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-caac4476-846d-4d38-881e-8c983f93bcd4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:38.359722 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8789f910-bd30-4ba1-84f5-a89a313a8f2c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:38.368789 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8789f910-bd30-4ba1-84f5-a89a313a8f2c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.351801 Jul 18 16:54:38.370002 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 211/418] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:38 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:38.386013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-a114f949-160d-4a4d-8060-1073f655e0b4 req-cefdbb5c-3ae5-4960-8f5e-36b5738bba22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10246df8-f808-47a9-947f-af78a2fd64c9", "name": "network-vif-plugged", "status": "completed", "tag": "4df48297-725a-439e-bb47-a2b832df545f"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:38.405358 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-a114f949-160d-4a4d-8060-1073f655e0b4 req-cefdbb5c-3ae5-4960-8f5e-36b5738bba22 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:38.406800 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-a114f949-160d-4a4d-8060-1073f655e0b4 req-cefdbb5c-3ae5-4960-8f5e-36b5738bba22 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:38.412272 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-caac4476-846d-4d38-881e-8c983f93bcd4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:38.426904 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-caac4476-846d-4d38-881e-8c983f93bcd4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1211 microversion: 2.1 time: 0.233889 Jul 18 16:54:38.437869 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 208/419] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:38 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1211 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:38.459038 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-a114f949-160d-4a4d-8060-1073f655e0b4 req-cefdbb5c-3ae5-4960-8f5e-36b5738bba22 service nova] Creating event network-vif-plugged:4df48297-725a-439e-bb47-a2b832df545f for instance 10246df8-f808-47a9-947f-af78a2fd64c9 on hv-cinder-83754 Jul 18 16:54:38.472970 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-a114f949-160d-4a4d-8060-1073f655e0b4 req-cefdbb5c-3ae5-4960-8f5e-36b5738bba22 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093196 Jul 18 16:54:38.476061 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 212/420] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:39.004274 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d46a26ab-af35-4f52-8973-9f7e4d01550f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:39.005621 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d46a26ab-af35-4f52-8973-9f7e4d01550f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:39.012556 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d46a26ab-af35-4f52-8973-9f7e4d01550f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.012707 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d46a26ab-af35-4f52-8973-9f7e4d01550f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.013580 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d46a26ab-af35-4f52-8973-9f7e4d01550f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.014388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d46a26ab-af35-4f52-8973-9f7e4d01550f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.058489 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d46a26ab-af35-4f52-8973-9f7e4d01550f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/ips" status: 200 len: 153 microversion: 2.20 time: 0.058790 Jul 18 16:54:39.064816 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 209/421] 10.222.0.76 () {60 vars in 1288 bytes} [Mon Jul 18 16:54:38 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/ips => generated 153 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:54:39.397606 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ce4cf567-5aca-411b-8000-1a167a0caa61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:39.399002 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ce4cf567-5aca-411b-8000-1a167a0caa61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:39.407369 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ce4cf567-5aca-411b-8000-1a167a0caa61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.408058 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ce4cf567-5aca-411b-8000-1a167a0caa61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.409271 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ce4cf567-5aca-411b-8000-1a167a0caa61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.409707 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ce4cf567-5aca-411b-8000-1a167a0caa61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.425734 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:39.446147 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e6b78c31-baaa-49a7-9885-14b2c3511df5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:39.447147 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e6b78c31-baaa-49a7-9885-14b2c3511df5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:39.458661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e6b78c31-baaa-49a7-9885-14b2c3511df5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.459417 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e6b78c31-baaa-49a7-9885-14b2c3511df5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.460556 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e6b78c31-baaa-49a7-9885-14b2c3511df5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.461183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e6b78c31-baaa-49a7-9885-14b2c3511df5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.597238 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ce4cf567-5aca-411b-8000-1a167a0caa61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:39.611384 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ce4cf567-5aca-411b-8000-1a167a0caa61 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.218487 Jul 18 16:54:39.612173 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 213/422] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:39 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:39.680092 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e6b78c31-baaa-49a7-9885-14b2c3511df5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:39.689066 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e6b78c31-baaa-49a7-9885-14b2c3511df5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1278 microversion: 2.1 time: 0.247404 Jul 18 16:54:39.690113 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 210/423] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:39 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1278 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:40.634054 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9005c543-f0ed-46ea-a223-ca0fcab4d884 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:40.635144 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9005c543-f0ed-46ea-a223-ca0fcab4d884 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:40.660096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9005c543-f0ed-46ea-a223-ca0fcab4d884 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:40.660769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9005c543-f0ed-46ea-a223-ca0fcab4d884 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:40.661985 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9005c543-f0ed-46ea-a223-ca0fcab4d884 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:40.678183 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9005c543-f0ed-46ea-a223-ca0fcab4d884 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:40.711678 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f7e63b06-4d5a-4702-b5c3-a30e6cd939cd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:40.713692 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f7e63b06-4d5a-4702-b5c3-a30e6cd939cd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:40.725905 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f7e63b06-4d5a-4702-b5c3-a30e6cd939cd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:40.726708 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f7e63b06-4d5a-4702-b5c3-a30e6cd939cd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:40.728311 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f7e63b06-4d5a-4702-b5c3-a30e6cd939cd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:40.729623 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f7e63b06-4d5a-4702-b5c3-a30e6cd939cd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:40.987716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9005c543-f0ed-46ea-a223-ca0fcab4d884 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:40.998456 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9005c543-f0ed-46ea-a223-ca0fcab4d884 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1371 microversion: 2.1 time: 0.370136 Jul 18 16:54:40.998611 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 214/424] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:40 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1371 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:41.114315 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f7e63b06-4d5a-4702-b5c3-a30e6cd939cd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:41.122825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f7e63b06-4d5a-4702-b5c3-a30e6cd939cd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1278 microversion: 2.1 time: 0.419706 Jul 18 16:54:41.123175 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 211/425] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:40 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1278 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:41.325986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-17bef3fe-993e-428a-9e8e-c42c7f8c36a5 req-0a9938fb-8604-4711-9a54-8fd469d9b90a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11140d5e-70e4-4716-ac6c-cef98b91640c", "tag": "bfb84bf6-a98e-4f78-9794-d40806a09eb5"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:41.338862 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-17bef3fe-993e-428a-9e8e-c42c7f8c36a5 req-0a9938fb-8604-4711-9a54-8fd469d9b90a service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:41.341544 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-17bef3fe-993e-428a-9e8e-c42c7f8c36a5 req-0a9938fb-8604-4711-9a54-8fd469d9b90a service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:41.360903 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-17bef3fe-993e-428a-9e8e-c42c7f8c36a5 req-0a9938fb-8604-4711-9a54-8fd469d9b90a service nova] Creating event network-changed:bfb84bf6-a98e-4f78-9794-d40806a09eb5 for instance 11140d5e-70e4-4716-ac6c-cef98b91640c on hv-cinder-83754 Jul 18 16:54:41.368888 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-17bef3fe-993e-428a-9e8e-c42c7f8c36a5 req-0a9938fb-8604-4711-9a54-8fd469d9b90a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049971 Jul 18 16:54:41.370162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 215/426] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:54:42.013767 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fffc6a37-82cb-49da-a308-ac1d8faced28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:42.015736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fffc6a37-82cb-49da-a308-ac1d8faced28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:42.023186 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fffc6a37-82cb-49da-a308-ac1d8faced28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.024133 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fffc6a37-82cb-49da-a308-ac1d8faced28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.025446 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fffc6a37-82cb-49da-a308-ac1d8faced28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.026258 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fffc6a37-82cb-49da-a308-ac1d8faced28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.142156 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ef589835-4f53-471c-a2ee-9ee4b8a405b1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:42.144361 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ef589835-4f53-471c-a2ee-9ee4b8a405b1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:42.169882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef589835-4f53-471c-a2ee-9ee4b8a405b1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.169882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef589835-4f53-471c-a2ee-9ee4b8a405b1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.176485 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef589835-4f53-471c-a2ee-9ee4b8a405b1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.177043 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef589835-4f53-471c-a2ee-9ee4b8a405b1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.252741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fffc6a37-82cb-49da-a308-ac1d8faced28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:42.262567 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fffc6a37-82cb-49da-a308-ac1d8faced28 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1566 microversion: 2.1 time: 0.252630 Jul 18 16:54:42.263854 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 212/427] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:42 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1566 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:42.283186 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-aa8e53e5-c6ef-4bad-9c46-ff29dce1dc7b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:42.290183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-aa8e53e5-c6ef-4bad-9c46-ff29dce1dc7b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:42.290319 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aa8e53e5-c6ef-4bad-9c46-ff29dce1dc7b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.290798 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aa8e53e5-c6ef-4bad-9c46-ff29dce1dc7b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.291698 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aa8e53e5-c6ef-4bad-9c46-ff29dce1dc7b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.292257 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aa8e53e5-c6ef-4bad-9c46-ff29dce1dc7b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.391425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-aa8e53e5-c6ef-4bad-9c46-ff29dce1dc7b tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112980 Jul 18 16:54:42.397712 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 213/428] 10.222.0.76 () {58 vars in 1274 bytes} [Mon Jul 18 16:54:42 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:42.401829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ef589835-4f53-471c-a2ee-9ee4b8a405b1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:42.416369 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ef589835-4f53-471c-a2ee-9ee4b8a405b1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.280080 Jul 18 16:54:42.427869 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 216/429] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:42 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:43.434234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-886f44f6-8bbc-4d15-a6e4-18e652d1870b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:43.435501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-886f44f6-8bbc-4d15-a6e4-18e652d1870b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:43.442787 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-886f44f6-8bbc-4d15-a6e4-18e652d1870b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:43.443478 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-886f44f6-8bbc-4d15-a6e4-18e652d1870b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:43.444417 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-886f44f6-8bbc-4d15-a6e4-18e652d1870b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:43.445029 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-886f44f6-8bbc-4d15-a6e4-18e652d1870b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:43.481938 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-970277c8-9cc7-4508-ab83-4d07907ee595 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:43.484555 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-970277c8-9cc7-4508-ab83-4d07907ee595 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:43.491314 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-970277c8-9cc7-4508-ab83-4d07907ee595 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:43.493943 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-970277c8-9cc7-4508-ab83-4d07907ee595 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:43.494914 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-970277c8-9cc7-4508-ab83-4d07907ee595 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:43.495542 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-970277c8-9cc7-4508-ab83-4d07907ee595 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:43.521930 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-970277c8-9cc7-4508-ab83-4d07907ee595 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lazy-loading 'flavor' on Instance uuid c3d31815-4f8c-4e76-adcb-8039b88488d0 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:54:43.712842 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-886f44f6-8bbc-4d15-a6e4-18e652d1870b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:43.724942 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-886f44f6-8bbc-4d15-a6e4-18e652d1870b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.294292 Jul 18 16:54:43.725661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 214/430] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:43 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:44.248277 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-970277c8-9cc7-4508-ab83-4d07907ee595 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "POST /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/action" status: 202 len: 0 microversion: 2.20 time: 0.769876 Jul 18 16:54:44.254346 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 217/431] 10.222.0.76 () {62 vars in 1318 bytes} [Mon Jul 18 16:54:43 2022] POST /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/action => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:54:44.260708 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a12be896-34ee-4b78-879d-a79568a354c3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:44.260708 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a12be896-34ee-4b78-879d-a79568a354c3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:44.270722 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a12be896-34ee-4b78-879d-a79568a354c3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:44.271179 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a12be896-34ee-4b78-879d-a79568a354c3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:44.271956 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a12be896-34ee-4b78-879d-a79568a354c3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:44.276447 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a12be896-34ee-4b78-879d-a79568a354c3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:44.390457 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-c9e192f0-05a1-431a-96ab-b322ae7e8f08 req-c2e75cb2-5239-4fb3-97bf-176a07405c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10246df8-f808-47a9-947f-af78a2fd64c9", "tag": "4df48297-725a-439e-bb47-a2b832df545f"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:44.394917 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:44.396538 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:44.414972 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c9e192f0-05a1-431a-96ab-b322ae7e8f08 req-c2e75cb2-5239-4fb3-97bf-176a07405c23 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:44.414972 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c9e192f0-05a1-431a-96ab-b322ae7e8f08 req-c2e75cb2-5239-4fb3-97bf-176a07405c23 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:44.440481 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-c9e192f0-05a1-431a-96ab-b322ae7e8f08 req-c2e75cb2-5239-4fb3-97bf-176a07405c23 service nova] Creating event network-changed:4df48297-725a-439e-bb47-a2b832df545f for instance 10246df8-f808-47a9-947f-af78a2fd64c9 on hv-cinder-83754 Jul 18 16:54:44.455500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-c9e192f0-05a1-431a-96ab-b322ae7e8f08 req-c2e75cb2-5239-4fb3-97bf-176a07405c23 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071066 Jul 18 16:54:44.456118 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 218/432] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:54:44.514672 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a12be896-34ee-4b78-879d-a79568a354c3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:44.525753 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a12be896-34ee-4b78-879d-a79568a354c3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:44.529809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a12be896-34ee-4b78-879d-a79568a354c3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:44.529809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a12be896-34ee-4b78-879d-a79568a354c3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.274155 Jul 18 16:54:44.529809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 215/433] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:54:44 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:54:44.744289 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6bbe3adc-a5b6-409b-9421-7e8bfc1fdfa6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:44.745688 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6bbe3adc-a5b6-409b-9421-7e8bfc1fdfa6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:44.753419 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6bbe3adc-a5b6-409b-9421-7e8bfc1fdfa6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:44.754171 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6bbe3adc-a5b6-409b-9421-7e8bfc1fdfa6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:44.755605 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6bbe3adc-a5b6-409b-9421-7e8bfc1fdfa6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:44.756539 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6bbe3adc-a5b6-409b-9421-7e8bfc1fdfa6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:44.926384 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6bbe3adc-a5b6-409b-9421-7e8bfc1fdfa6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:44.935217 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6bbe3adc-a5b6-409b-9421-7e8bfc1fdfa6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.195781 Jul 18 16:54:44.945671 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 219/434] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:44 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:45.550917 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-af8df93c-e11d-45c1-a075-9bb39d6482c7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:45.557747 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-af8df93c-e11d-45c1-a075-9bb39d6482c7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:45.576180 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af8df93c-e11d-45c1-a075-9bb39d6482c7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:45.579449 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af8df93c-e11d-45c1-a075-9bb39d6482c7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:45.581960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af8df93c-e11d-45c1-a075-9bb39d6482c7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:45.582589 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af8df93c-e11d-45c1-a075-9bb39d6482c7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:45.833853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-af8df93c-e11d-45c1-a075-9bb39d6482c7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:45.845935 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-af8df93c-e11d-45c1-a075-9bb39d6482c7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:45.850028 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-af8df93c-e11d-45c1-a075-9bb39d6482c7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:45.851777 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-af8df93c-e11d-45c1-a075-9bb39d6482c7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.308776 Jul 18 16:54:45.852922 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 216/435] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:54:45 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:54:45.951969 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aa53350c-e37c-4ba4-a6e6-21abd89483b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:45.954182 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aa53350c-e37c-4ba4-a6e6-21abd89483b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:45.958125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:45.962059 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa53350c-e37c-4ba4-a6e6-21abd89483b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:45.962996 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa53350c-e37c-4ba4-a6e6-21abd89483b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:45.964195 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa53350c-e37c-4ba4-a6e6-21abd89483b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:45.964895 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa53350c-e37c-4ba4-a6e6-21abd89483b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:46.136604 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aa53350c-e37c-4ba4-a6e6-21abd89483b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:46.145286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aa53350c-e37c-4ba4-a6e6-21abd89483b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.196944 Jul 18 16:54:46.146055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 220/436] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:45 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:46.870620 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b0d7ef09-cca9-4713-b072-940f47cc63c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:46.871170 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b0d7ef09-cca9-4713-b072-940f47cc63c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:46.873056 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=4 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:46.878768 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b0d7ef09-cca9-4713-b072-940f47cc63c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.883089 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b0d7ef09-cca9-4713-b072-940f47cc63c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:46.883089 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b0d7ef09-cca9-4713-b072-940f47cc63c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.883089 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b0d7ef09-cca9-4713-b072-940f47cc63c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:47.040741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b0d7ef09-cca9-4713-b072-940f47cc63c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:47.051115 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b0d7ef09-cca9-4713-b072-940f47cc63c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:47.052778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b0d7ef09-cca9-4713-b072-940f47cc63c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:47.054381 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b0d7ef09-cca9-4713-b072-940f47cc63c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.187765 Jul 18 16:54:47.065976 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 217/437] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:54:46 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:54:47.162525 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-14682464-c4cd-4097-b48a-75353091ffee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:47.163235 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-14682464-c4cd-4097-b48a-75353091ffee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:47.175409 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14682464-c4cd-4097-b48a-75353091ffee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:47.176138 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14682464-c4cd-4097-b48a-75353091ffee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:47.188069 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14682464-c4cd-4097-b48a-75353091ffee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:47.188069 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14682464-c4cd-4097-b48a-75353091ffee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:47.357716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-14682464-c4cd-4097-b48a-75353091ffee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:47.366083 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-14682464-c4cd-4097-b48a-75353091ffee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.207564 Jul 18 16:54:47.366693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 221/438] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:47 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:47.433310 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1902149275", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1556813197", "security_groups": [{"name": "tempest-secgroup-smoke-1530323907"}], "networks": [{"uuid": "c13a6093-77ca-4a5f-a9eb-b2f8466ab338"}], "block_device_mapping_v2": [{"uuid": "3fee632a-f693-4abf-a981-326dceb0e6a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:47.574997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] validate_networks() for [('c13a6093-77ca-4a5f-a9eb-b2f8466ab338', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:54:48.043736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:54:48.044314 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:54:48.044915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:54:48.045536 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:54:48.046074 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:54:48.057436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:48.058695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:48.060529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:48.061440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:48.076279 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9d1f5044-c443-4ca1-b6e5-464b551beb87 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:48.078498 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9d1f5044-c443-4ca1-b6e5-464b551beb87 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:48.085864 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9d1f5044-c443-4ca1-b6e5-464b551beb87 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:48.086789 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9d1f5044-c443-4ca1-b6e5-464b551beb87 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:48.087936 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9d1f5044-c443-4ca1-b6e5-464b551beb87 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:48.088728 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9d1f5044-c443-4ca1-b6e5-464b551beb87 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:48.089077 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Getting quotas for project 46abecf729dd426f9ffc02cee5d67150. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:54:48.097588 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Getting quotas for user 9011730621194d0e8165de381177bd2e and project 46abecf729dd426f9ffc02cee5d67150. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:54:48.183451 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:54:48.186546 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3fee632a-f693-4abf-a981-326dceb0e6a8',volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:54:48.273996 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9d1f5044-c443-4ca1-b6e5-464b551beb87 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:48.283211 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9d1f5044-c443-4ca1-b6e5-464b551beb87 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:48.284737 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9d1f5044-c443-4ca1-b6e5-464b551beb87 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:48.286065 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9d1f5044-c443-4ca1-b6e5-464b551beb87 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.216143 Jul 18 16:54:48.286570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 222/439] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:54:48 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:54:48.389082 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-887247fe-53d9-4b07-b3bb-1e373ff284f7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:48.389788 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-887247fe-53d9-4b07-b3bb-1e373ff284f7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:48.398811 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-887247fe-53d9-4b07-b3bb-1e373ff284f7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:48.399405 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-887247fe-53d9-4b07-b3bb-1e373ff284f7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:48.400511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-887247fe-53d9-4b07-b3bb-1e373ff284f7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:48.401003 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-887247fe-53d9-4b07-b3bb-1e373ff284f7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:48.567883 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-887247fe-53d9-4b07-b3bb-1e373ff284f7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:48.577472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-887247fe-53d9-4b07-b3bb-1e373ff284f7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.193516 Jul 18 16:54:48.587767 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 223/440] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:48 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:48.750106 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR oslo.messaging._drivers.impl_rabbit [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [bab10cb9-6cfa-40f8-81a6-0f035ca8b3ae] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 16:54:49.306199 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-968e6af8-0d5b-42ce-accd-39caeee98def tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:49.307072 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-968e6af8-0d5b-42ce-accd-39caeee98def tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:49.320329 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-968e6af8-0d5b-42ce-accd-39caeee98def tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:49.320948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-968e6af8-0d5b-42ce-accd-39caeee98def tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:49.322114 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-968e6af8-0d5b-42ce-accd-39caeee98def tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:49.322722 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-968e6af8-0d5b-42ce-accd-39caeee98def tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:49.485576 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-968e6af8-0d5b-42ce-accd-39caeee98def tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:49.496456 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-968e6af8-0d5b-42ce-accd-39caeee98def tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:49.498030 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-968e6af8-0d5b-42ce-accd-39caeee98def tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:49.499303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-968e6af8-0d5b-42ce-accd-39caeee98def tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.199046 Jul 18 16:54:49.511501 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 224/441] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:54:49 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:54:49.596061 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c847da1a-fa1b-4f75-905b-7766802b814d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:49.596559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c847da1a-fa1b-4f75-905b-7766802b814d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:49.603584 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c847da1a-fa1b-4f75-905b-7766802b814d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:49.604127 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c847da1a-fa1b-4f75-905b-7766802b814d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:49.604946 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c847da1a-fa1b-4f75-905b-7766802b814d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:49.605417 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c847da1a-fa1b-4f75-905b-7766802b814d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:49.756908 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [bab10cb9-6cfa-40f8-81a6-0f035ca8b3ae] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 58858. Jul 18 16:54:49.779696 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-51e01342-37d2-47fb-ada8-06298f6c183b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.350243 Jul 18 16:54:49.781288 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 218/442] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:54:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 2352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:54:49.791671 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-21034a8c-757a-4d12-a33c-bbd5078adf38 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:49.792370 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-21034a8c-757a-4d12-a33c-bbd5078adf38 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:49.801219 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c847da1a-fa1b-4f75-905b-7766802b814d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:49.812073 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c847da1a-fa1b-4f75-905b-7766802b814d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.220306 Jul 18 16:54:49.820592 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 225/443] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:49 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:49.861254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-21034a8c-757a-4d12-a33c-bbd5078adf38 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:49.868915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-21034a8c-757a-4d12-a33c-bbd5078adf38 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1089 microversion: 2.1 time: 0.081333 Jul 18 16:54:49.873488 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 219/444] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:49 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1089 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:50.519649 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-81dbc495-e7d1-4152-958f-a1b2f4bb1cd2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:50.521504 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-81dbc495-e7d1-4152-958f-a1b2f4bb1cd2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:50.528031 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81dbc495-e7d1-4152-958f-a1b2f4bb1cd2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:50.528693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81dbc495-e7d1-4152-958f-a1b2f4bb1cd2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:50.529503 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81dbc495-e7d1-4152-958f-a1b2f4bb1cd2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:50.530095 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81dbc495-e7d1-4152-958f-a1b2f4bb1cd2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:50.753771 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-81dbc495-e7d1-4152-958f-a1b2f4bb1cd2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:50.765494 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-81dbc495-e7d1-4152-958f-a1b2f4bb1cd2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:50.767611 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-81dbc495-e7d1-4152-958f-a1b2f4bb1cd2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:50.769778 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-81dbc495-e7d1-4152-958f-a1b2f4bb1cd2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.254658 Jul 18 16:54:50.782545 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 226/445] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:54:50 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:54:50.840001 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-44b72010-c5d8-44a5-adb2-3e5946d8462e tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:50.843264 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-44b72010-c5d8-44a5-adb2-3e5946d8462e tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:50.849729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-44b72010-c5d8-44a5-adb2-3e5946d8462e tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:50.850540 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-44b72010-c5d8-44a5-adb2-3e5946d8462e tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:50.851705 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-44b72010-c5d8-44a5-adb2-3e5946d8462e tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:50.852586 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-44b72010-c5d8-44a5-adb2-3e5946d8462e tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:50.886870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-11215890-99ae-434f-ac51-4473f62266fc tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:50.887473 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-11215890-99ae-434f-ac51-4473f62266fc tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:50.957923 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-11215890-99ae-434f-ac51-4473f62266fc tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:50.965381 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-11215890-99ae-434f-ac51-4473f62266fc tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1089 microversion: 2.1 time: 0.082021 Jul 18 16:54:50.966280 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 227/446] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:50 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1089 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:51.018651 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-44b72010-c5d8-44a5-adb2-3e5946d8462e tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:51.027452 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-44b72010-c5d8-44a5-adb2-3e5946d8462e tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.193989 Jul 18 16:54:51.028258 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 220/447] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:50 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:51.790006 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3a39375e-47c9-4d70-8487-b63066c52749 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:51.790612 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3a39375e-47c9-4d70-8487-b63066c52749 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:51.797796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a39375e-47c9-4d70-8487-b63066c52749 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.798256 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a39375e-47c9-4d70-8487-b63066c52749 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.799064 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a39375e-47c9-4d70-8487-b63066c52749 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.799510 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a39375e-47c9-4d70-8487-b63066c52749 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.929078 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3a39375e-47c9-4d70-8487-b63066c52749 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:51.938032 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3a39375e-47c9-4d70-8487-b63066c52749 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:51.939555 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3a39375e-47c9-4d70-8487-b63066c52749 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:51.940795 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3a39375e-47c9-4d70-8487-b63066c52749 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.154713 Jul 18 16:54:51.941513 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 228/448] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:54:51 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:54:51.981704 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f176b48b-bfd3-4b6f-8f11-80073d43e046 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:51.982309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f176b48b-bfd3-4b6f-8f11-80073d43e046 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:51.989647 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f176b48b-bfd3-4b6f-8f11-80073d43e046 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.990093 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f176b48b-bfd3-4b6f-8f11-80073d43e046 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.990897 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f176b48b-bfd3-4b6f-8f11-80073d43e046 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.991329 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f176b48b-bfd3-4b6f-8f11-80073d43e046 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:52.046329 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f7c30a51-da6a-43fe-8898-ae64b9489c36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:52.046940 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f7c30a51-da6a-43fe-8898-ae64b9489c36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:52.054268 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7c30a51-da6a-43fe-8898-ae64b9489c36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:52.054399 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f176b48b-bfd3-4b6f-8f11-80073d43e046 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:52.054882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7c30a51-da6a-43fe-8898-ae64b9489c36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:52.055676 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7c30a51-da6a-43fe-8898-ae64b9489c36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:52.056165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7c30a51-da6a-43fe-8898-ae64b9489c36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:52.062362 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f176b48b-bfd3-4b6f-8f11-80073d43e046 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1139 microversion: 2.1 time: 0.083963 Jul 18 16:54:52.062936 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 221/449] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:51 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:52.199760 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f7c30a51-da6a-43fe-8898-ae64b9489c36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:52.208037 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f7c30a51-da6a-43fe-8898-ae64b9489c36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.165627 Jul 18 16:54:52.208612 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 229/450] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:52 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:52.959729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6d0f2fbf-ccdc-4f8f-952c-55c746415dc5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:52.960323 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6d0f2fbf-ccdc-4f8f-952c-55c746415dc5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:52.973454 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d0f2fbf-ccdc-4f8f-952c-55c746415dc5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:52.973907 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d0f2fbf-ccdc-4f8f-952c-55c746415dc5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:52.974704 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d0f2fbf-ccdc-4f8f-952c-55c746415dc5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:52.975124 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d0f2fbf-ccdc-4f8f-952c-55c746415dc5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:53.080691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0bcfbd73-ce43-4459-8490-ca1512f5ec13 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:53.081265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0bcfbd73-ce43-4459-8490-ca1512f5ec13 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:53.088499 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0bcfbd73-ce43-4459-8490-ca1512f5ec13 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:53.088955 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0bcfbd73-ce43-4459-8490-ca1512f5ec13 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:53.089774 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0bcfbd73-ce43-4459-8490-ca1512f5ec13 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:53.090243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0bcfbd73-ce43-4459-8490-ca1512f5ec13 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:53.113245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6d0f2fbf-ccdc-4f8f-952c-55c746415dc5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:53.116437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:53.125083 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6d0f2fbf-ccdc-4f8f-952c-55c746415dc5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:53.126658 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6d0f2fbf-ccdc-4f8f-952c-55c746415dc5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:53.127955 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6d0f2fbf-ccdc-4f8f-952c-55c746415dc5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.172049 Jul 18 16:54:53.128675 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 222/451] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:54:52 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:54:53.177505 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0bcfbd73-ce43-4459-8490-ca1512f5ec13 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:53.184974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0bcfbd73-ce43-4459-8490-ca1512f5ec13 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1187 microversion: 2.1 time: 0.109158 Jul 18 16:54:53.185571 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 230/452] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:53 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1187 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:53.225324 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5260d864-37b5-4faa-b163-f4abcb004d81 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:53.225940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5260d864-37b5-4faa-b163-f4abcb004d81 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:53.232045 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5260d864-37b5-4faa-b163-f4abcb004d81 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:53.233233 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5260d864-37b5-4faa-b163-f4abcb004d81 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:53.233359 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5260d864-37b5-4faa-b163-f4abcb004d81 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:53.233710 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5260d864-37b5-4faa-b163-f4abcb004d81 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:53.371131 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5260d864-37b5-4faa-b163-f4abcb004d81 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:53.379415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5260d864-37b5-4faa-b163-f4abcb004d81 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.158107 Jul 18 16:54:53.379983 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 223/453] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:53 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:54.155075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fb184e02-3f19-47a6-bd35-d3d46a244b4d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:54.156452 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fb184e02-3f19-47a6-bd35-d3d46a244b4d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:54.163892 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb184e02-3f19-47a6-bd35-d3d46a244b4d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.164454 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb184e02-3f19-47a6-bd35-d3d46a244b4d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.165263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb184e02-3f19-47a6-bd35-d3d46a244b4d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.165715 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb184e02-3f19-47a6-bd35-d3d46a244b4d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.211887 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d8431d67-c013-4dad-a311-3a09bd167ea8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:54.212723 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d8431d67-c013-4dad-a311-3a09bd167ea8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:54.220385 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8431d67-c013-4dad-a311-3a09bd167ea8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.221341 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8431d67-c013-4dad-a311-3a09bd167ea8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.222504 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8431d67-c013-4dad-a311-3a09bd167ea8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.223156 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8431d67-c013-4dad-a311-3a09bd167ea8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.324027 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fb184e02-3f19-47a6-bd35-d3d46a244b4d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:54.325746 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d8431d67-c013-4dad-a311-3a09bd167ea8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:54.333306 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fb184e02-3f19-47a6-bd35-d3d46a244b4d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:54.334080 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d8431d67-c013-4dad-a311-3a09bd167ea8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1205 microversion: 2.1 time: 0.126208 Jul 18 16:54:54.334669 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 224/454] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:54 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1205 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:54.334904 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fb184e02-3f19-47a6-bd35-d3d46a244b4d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:54.337295 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fb184e02-3f19-47a6-bd35-d3d46a244b4d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.192518 Jul 18 16:54:54.337852 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 231/455] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:54:54 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:54:54.396639 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ddf13a77-97ea-4d43-afdd-77fdfa1c31ef tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:54.397274 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ddf13a77-97ea-4d43-afdd-77fdfa1c31ef tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:54.404141 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddf13a77-97ea-4d43-afdd-77fdfa1c31ef tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.404652 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddf13a77-97ea-4d43-afdd-77fdfa1c31ef tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.405816 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddf13a77-97ea-4d43-afdd-77fdfa1c31ef tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.406315 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddf13a77-97ea-4d43-afdd-77fdfa1c31ef tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.634558 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ddf13a77-97ea-4d43-afdd-77fdfa1c31ef tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:54.642749 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ddf13a77-97ea-4d43-afdd-77fdfa1c31ef tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.249804 Jul 18 16:54:54.643318 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 225/456] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:54 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:55.355113 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-11b13a10-768b-4b20-b8af-c32e29496db3 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:55.356510 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-11b13a10-768b-4b20-b8af-c32e29496db3 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:55.360001 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-210ef40a-3201-42c4-bbd2-22ae44539d9d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:55.362752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-210ef40a-3201-42c4-bbd2-22ae44539d9d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:55.363989 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11b13a10-768b-4b20-b8af-c32e29496db3 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.368371 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-210ef40a-3201-42c4-bbd2-22ae44539d9d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.369075 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-210ef40a-3201-42c4-bbd2-22ae44539d9d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.370140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-210ef40a-3201-42c4-bbd2-22ae44539d9d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.370833 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-210ef40a-3201-42c4-bbd2-22ae44539d9d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.373758 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11b13a10-768b-4b20-b8af-c32e29496db3 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.374692 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11b13a10-768b-4b20-b8af-c32e29496db3 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.375145 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11b13a10-768b-4b20-b8af-c32e29496db3 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.387498 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:55.548742 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-11b13a10-768b-4b20-b8af-c32e29496db3 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:55.556875 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-11b13a10-768b-4b20-b8af-c32e29496db3 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1273 microversion: 2.1 time: 0.207742 Jul 18 16:54:55.558222 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 232/457] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:55 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:55.590762 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-210ef40a-3201-42c4-bbd2-22ae44539d9d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:55.602950 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-210ef40a-3201-42c4-bbd2-22ae44539d9d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:55.604702 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-210ef40a-3201-42c4-bbd2-22ae44539d9d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:55.606542 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-210ef40a-3201-42c4-bbd2-22ae44539d9d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.253621 Jul 18 16:54:55.607994 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 226/458] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:54:55 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:54:55.666649 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-705d7b3b-a55a-4fb5-813c-b37143d2a9af tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:55.666649 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-705d7b3b-a55a-4fb5-813c-b37143d2a9af tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:55.668839 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-705d7b3b-a55a-4fb5-813c-b37143d2a9af tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.669624 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-705d7b3b-a55a-4fb5-813c-b37143d2a9af tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.670681 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-705d7b3b-a55a-4fb5-813c-b37143d2a9af tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.672131 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-705d7b3b-a55a-4fb5-813c-b37143d2a9af tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.794529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-8b8eb2f5-7deb-444c-986a-c159c987a001 req-7be727bc-eff6-4684-8e06-03655a3ea3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d25fa4-9505-4471-a0be-e3a486297f2d", "tag": "f3c39284-35e1-4778-990a-0024c4b94641"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:55.809595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-8b8eb2f5-7deb-444c-986a-c159c987a001 req-7be727bc-eff6-4684-8e06-03655a3ea3d4 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.810431 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-8b8eb2f5-7deb-444c-986a-c159c987a001 req-7be727bc-eff6-4684-8e06-03655a3ea3d4 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.837289 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-8b8eb2f5-7deb-444c-986a-c159c987a001 req-7be727bc-eff6-4684-8e06-03655a3ea3d4 service nova] Creating event network-changed:f3c39284-35e1-4778-990a-0024c4b94641 for instance 87d25fa4-9505-4471-a0be-e3a486297f2d on hv-cinder-83754 Jul 18 16:54:55.845905 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-8b8eb2f5-7deb-444c-986a-c159c987a001 req-7be727bc-eff6-4684-8e06-03655a3ea3d4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055079 Jul 18 16:54:55.846175 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 227/459] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:55.904608 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-705d7b3b-a55a-4fb5-813c-b37143d2a9af tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:55.918823 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-705d7b3b-a55a-4fb5-813c-b37143d2a9af tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.261996 Jul 18 16:54:55.919423 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 233/460] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:55 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:56.503632 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-aa562589-9b9a-43c7-a2d1-4696e3df2ed1 req-0d3d0849-e3d3-4f10-b2e6-b3d52bf9eabe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11140d5e-70e4-4716-ac6c-cef98b91640c", "name": "network-vif-plugged", "status": "completed", "tag": "bfb84bf6-a98e-4f78-9794-d40806a09eb5"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:56.512109 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-aa562589-9b9a-43c7-a2d1-4696e3df2ed1 req-0d3d0849-e3d3-4f10-b2e6-b3d52bf9eabe service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:56.512681 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-aa562589-9b9a-43c7-a2d1-4696e3df2ed1 req-0d3d0849-e3d3-4f10-b2e6-b3d52bf9eabe service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:56.524260 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-aa562589-9b9a-43c7-a2d1-4696e3df2ed1 req-0d3d0849-e3d3-4f10-b2e6-b3d52bf9eabe service nova] Creating event network-vif-plugged:bfb84bf6-a98e-4f78-9794-d40806a09eb5 for instance 11140d5e-70e4-4716-ac6c-cef98b91640c on hv-cinder-83754 Jul 18 16:54:56.529042 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-aa562589-9b9a-43c7-a2d1-4696e3df2ed1 req-0d3d0849-e3d3-4f10-b2e6-b3d52bf9eabe service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030048 Jul 18 16:54:56.529652 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 228/461] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:56.575815 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ae812ccf-26cc-4104-82d9-10fca214fa46 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:56.577211 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ae812ccf-26cc-4104-82d9-10fca214fa46 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:56.600891 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae812ccf-26cc-4104-82d9-10fca214fa46 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:56.605120 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae812ccf-26cc-4104-82d9-10fca214fa46 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:56.605120 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae812ccf-26cc-4104-82d9-10fca214fa46 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:56.605120 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae812ccf-26cc-4104-82d9-10fca214fa46 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:56.629302 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ff04c535-4557-4d53-bd0d-39428055a228 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:56.629999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ff04c535-4557-4d53-bd0d-39428055a228 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:56.645141 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff04c535-4557-4d53-bd0d-39428055a228 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:56.645589 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff04c535-4557-4d53-bd0d-39428055a228 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:56.646370 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff04c535-4557-4d53-bd0d-39428055a228 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:56.646803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff04c535-4557-4d53-bd0d-39428055a228 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:56.780280 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ae812ccf-26cc-4104-82d9-10fca214fa46 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:56.787993 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ae812ccf-26cc-4104-82d9-10fca214fa46 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.216124 Jul 18 16:54:56.788564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 234/462] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:56 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:56.847441 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ff04c535-4557-4d53-bd0d-39428055a228 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:56.855685 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ff04c535-4557-4d53-bd0d-39428055a228 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:56.857301 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ff04c535-4557-4d53-bd0d-39428055a228 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:56.859634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ff04c535-4557-4d53-bd0d-39428055a228 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.235764 Jul 18 16:54:56.860353 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 229/463] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:54:56 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:54:56.936450 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f98c4526-925a-4245-9a8d-0d69c220c0b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:56.937691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f98c4526-925a-4245-9a8d-0d69c220c0b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:56.944216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f98c4526-925a-4245-9a8d-0d69c220c0b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:56.944678 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f98c4526-925a-4245-9a8d-0d69c220c0b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:56.945491 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f98c4526-925a-4245-9a8d-0d69c220c0b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:56.946109 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f98c4526-925a-4245-9a8d-0d69c220c0b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:57.092081 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f98c4526-925a-4245-9a8d-0d69c220c0b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:57.103795 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f98c4526-925a-4245-9a8d-0d69c220c0b9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.169098 Jul 18 16:54:57.104480 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 235/464] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:56 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:57.806426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4d14c658-c3af-4fc5-a2a7-7f288fcd2c40 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:57.807018 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4d14c658-c3af-4fc5-a2a7-7f288fcd2c40 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:57.813202 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4d14c658-c3af-4fc5-a2a7-7f288fcd2c40 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:57.813655 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4d14c658-c3af-4fc5-a2a7-7f288fcd2c40 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:57.814421 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4d14c658-c3af-4fc5-a2a7-7f288fcd2c40 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:57.814891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4d14c658-c3af-4fc5-a2a7-7f288fcd2c40 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:57.880925 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a2a7d12a-3202-4ff5-9728-4ebed562798b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:57.881576 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a2a7d12a-3202-4ff5-9728-4ebed562798b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:57.888265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a2a7d12a-3202-4ff5-9728-4ebed562798b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:57.888720 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a2a7d12a-3202-4ff5-9728-4ebed562798b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:57.889539 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a2a7d12a-3202-4ff5-9728-4ebed562798b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:57.891136 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a2a7d12a-3202-4ff5-9728-4ebed562798b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:57.964090 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4d14c658-c3af-4fc5-a2a7-7f288fcd2c40 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:57.974111 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4d14c658-c3af-4fc5-a2a7-7f288fcd2c40 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.171802 Jul 18 16:54:57.974937 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 230/465] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:57 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:58.049380 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a2a7d12a-3202-4ff5-9728-4ebed562798b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:58.057944 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a2a7d12a-3202-4ff5-9728-4ebed562798b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:58.059419 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a2a7d12a-3202-4ff5-9728-4ebed562798b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:58.060656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a2a7d12a-3202-4ff5-9728-4ebed562798b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.183688 Jul 18 16:54:58.061238 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 236/466] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:54:57 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:54:58.122063 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f05d201a-334f-4787-9760-e90af7d84db0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:58.123978 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f05d201a-334f-4787-9760-e90af7d84db0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:58.126568 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:58.130474 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f05d201a-334f-4787-9760-e90af7d84db0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:58.130935 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f05d201a-334f-4787-9760-e90af7d84db0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:58.131717 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f05d201a-334f-4787-9760-e90af7d84db0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:58.132159 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f05d201a-334f-4787-9760-e90af7d84db0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:58.280858 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f05d201a-334f-4787-9760-e90af7d84db0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:58.288914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f05d201a-334f-4787-9760-e90af7d84db0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.170760 Jul 18 16:54:58.289433 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 231/467] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:58 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:58.990867 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dda97dcc-926f-4b41-8684-6d2ff9f42c78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:58.991472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dda97dcc-926f-4b41-8684-6d2ff9f42c78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:58.997934 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dda97dcc-926f-4b41-8684-6d2ff9f42c78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:58.998391 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dda97dcc-926f-4b41-8684-6d2ff9f42c78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:58.999664 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dda97dcc-926f-4b41-8684-6d2ff9f42c78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:59.000102 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dda97dcc-926f-4b41-8684-6d2ff9f42c78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:59.081181 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-42b71884-e591-49ae-b749-9ff8f2926e24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:59.081816 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-42b71884-e591-49ae-b749-9ff8f2926e24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:59.088063 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-42b71884-e591-49ae-b749-9ff8f2926e24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:59.088611 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-42b71884-e591-49ae-b749-9ff8f2926e24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:59.089357 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-42b71884-e591-49ae-b749-9ff8f2926e24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:59.089738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-42b71884-e591-49ae-b749-9ff8f2926e24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:59.169671 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dda97dcc-926f-4b41-8684-6d2ff9f42c78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:59.179552 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dda97dcc-926f-4b41-8684-6d2ff9f42c78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.192505 Jul 18 16:54:59.180230 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 237/468] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:58 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:59.230162 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-42b71884-e591-49ae-b749-9ff8f2926e24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:59.239617 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-42b71884-e591-49ae-b749-9ff8f2926e24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:59.241160 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-42b71884-e591-49ae-b749-9ff8f2926e24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:59.242357 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-42b71884-e591-49ae-b749-9ff8f2926e24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.165227 Jul 18 16:54:59.242925 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 232/469] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:54:59 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:54:59.306208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-41a14a48-6a2a-4ac5-a546-4efda5a7372d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:59.306832 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-41a14a48-6a2a-4ac5-a546-4efda5a7372d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:59.313501 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41a14a48-6a2a-4ac5-a546-4efda5a7372d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:59.313952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41a14a48-6a2a-4ac5-a546-4efda5a7372d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:59.314724 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41a14a48-6a2a-4ac5-a546-4efda5a7372d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:59.315158 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41a14a48-6a2a-4ac5-a546-4efda5a7372d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:59.504159 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-41a14a48-6a2a-4ac5-a546-4efda5a7372d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:59.512395 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-41a14a48-6a2a-4ac5-a546-4efda5a7372d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1266 microversion: 2.1 time: 0.209930 Jul 18 16:54:59.513046 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 238/470] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:59 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:00.197800 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b728e34c-6cd2-49c5-8ef0-d55107696b9c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:00.198539 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b728e34c-6cd2-49c5-8ef0-d55107696b9c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:00.201622 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=8 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:00.205763 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b728e34c-6cd2-49c5-8ef0-d55107696b9c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:00.206218 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b728e34c-6cd2-49c5-8ef0-d55107696b9c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:00.207006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b728e34c-6cd2-49c5-8ef0-d55107696b9c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:00.207442 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b728e34c-6cd2-49c5-8ef0-d55107696b9c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:00.264918 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a66a9640-f8bb-4d1a-be8e-1ceb0f96a5a0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:00.265615 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a66a9640-f8bb-4d1a-be8e-1ceb0f96a5a0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:00.272784 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a66a9640-f8bb-4d1a-be8e-1ceb0f96a5a0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:00.273274 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a66a9640-f8bb-4d1a-be8e-1ceb0f96a5a0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:00.274058 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a66a9640-f8bb-4d1a-be8e-1ceb0f96a5a0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:00.274495 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a66a9640-f8bb-4d1a-be8e-1ceb0f96a5a0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:00.384772 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b728e34c-6cd2-49c5-8ef0-d55107696b9c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:00.394869 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b728e34c-6cd2-49c5-8ef0-d55107696b9c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.200575 Jul 18 16:55:00.395639 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 233/471] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:00 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:00.451490 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a66a9640-f8bb-4d1a-be8e-1ceb0f96a5a0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:00.462125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a66a9640-f8bb-4d1a-be8e-1ceb0f96a5a0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:00.462125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a66a9640-f8bb-4d1a-be8e-1ceb0f96a5a0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:00.463135 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a66a9640-f8bb-4d1a-be8e-1ceb0f96a5a0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.202383 Jul 18 16:55:00.463685 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 239/472] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:00 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:00.532830 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1d672ae6-950a-494f-b619-896244166b92 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:00.533478 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1d672ae6-950a-494f-b619-896244166b92 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:00.539616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1d672ae6-950a-494f-b619-896244166b92 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:00.540057 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1d672ae6-950a-494f-b619-896244166b92 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:00.540818 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1d672ae6-950a-494f-b619-896244166b92 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:00.541281 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1d672ae6-950a-494f-b619-896244166b92 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:01.072904 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1d672ae6-950a-494f-b619-896244166b92 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:01.082098 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1d672ae6-950a-494f-b619-896244166b92 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1452 microversion: 2.1 time: 0.554203 Jul 18 16:55:01.082862 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 234/473] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:00 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1452 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:01.099520 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-585f6e29-0d21-4825-bbde-e2b01ddeb325 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:01.100423 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-585f6e29-0d21-4825-bbde-e2b01ddeb325 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:01.102383 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:01.108129 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-585f6e29-0d21-4825-bbde-e2b01ddeb325 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:01.108845 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-585f6e29-0d21-4825-bbde-e2b01ddeb325 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:01.110231 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-585f6e29-0d21-4825-bbde-e2b01ddeb325 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:01.110672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-585f6e29-0d21-4825-bbde-e2b01ddeb325 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:01.293160 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-585f6e29-0d21-4825-bbde-e2b01ddeb325 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:01.307158 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-585f6e29-0d21-4825-bbde-e2b01ddeb325 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1452 microversion: 2.1 time: 0.211653 Jul 18 16:55:01.307744 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 240/474] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:01 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1452 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:01.417566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b96d1970-ecd9-4ae0-ad4e-cb8181de058b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:01.418186 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b96d1970-ecd9-4ae0-ad4e-cb8181de058b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:01.428050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b96d1970-ecd9-4ae0-ad4e-cb8181de058b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:01.429666 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b96d1970-ecd9-4ae0-ad4e-cb8181de058b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:01.430767 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b96d1970-ecd9-4ae0-ad4e-cb8181de058b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:01.431214 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b96d1970-ecd9-4ae0-ad4e-cb8181de058b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:01.485938 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7f4f30ca-ad27-472c-9fa6-63dd910bd989 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:01.486670 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7f4f30ca-ad27-472c-9fa6-63dd910bd989 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:01.495272 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7f4f30ca-ad27-472c-9fa6-63dd910bd989 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:01.503099 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7f4f30ca-ad27-472c-9fa6-63dd910bd989 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:01.503099 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7f4f30ca-ad27-472c-9fa6-63dd910bd989 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:01.503099 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7f4f30ca-ad27-472c-9fa6-63dd910bd989 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:01.686523 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7f4f30ca-ad27-472c-9fa6-63dd910bd989 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:01.697098 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7f4f30ca-ad27-472c-9fa6-63dd910bd989 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:01.698983 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7f4f30ca-ad27-472c-9fa6-63dd910bd989 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:01.700168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7f4f30ca-ad27-472c-9fa6-63dd910bd989 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.221678 Jul 18 16:55:01.700733 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 241/475] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:01 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:01.740345 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b96d1970-ecd9-4ae0-ad4e-cb8181de058b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:01.755447 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b96d1970-ecd9-4ae0-ad4e-cb8181de058b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.345290 Jul 18 16:55:01.756641 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 235/476] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:01 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:02.720551 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e378445b-2add-4947-8f4f-b1af9e4c3af7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:02.721982 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e378445b-2add-4947-8f4f-b1af9e4c3af7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:02.732435 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e378445b-2add-4947-8f4f-b1af9e4c3af7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:02.736829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e378445b-2add-4947-8f4f-b1af9e4c3af7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:02.739600 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e378445b-2add-4947-8f4f-b1af9e4c3af7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:02.740347 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e378445b-2add-4947-8f4f-b1af9e4c3af7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:02.774231 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-334db999-a7e9-4871-9013-cf4e974c2c11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:02.774666 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-334db999-a7e9-4871-9013-cf4e974c2c11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:02.782970 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-334db999-a7e9-4871-9013-cf4e974c2c11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:02.783954 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-334db999-a7e9-4871-9013-cf4e974c2c11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:02.784928 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-334db999-a7e9-4871-9013-cf4e974c2c11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:02.785448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-334db999-a7e9-4871-9013-cf4e974c2c11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:02.951639 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e378445b-2add-4947-8f4f-b1af9e4c3af7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:02.962433 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e378445b-2add-4947-8f4f-b1af9e4c3af7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:02.963940 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e378445b-2add-4947-8f4f-b1af9e4c3af7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:02.965136 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e378445b-2add-4947-8f4f-b1af9e4c3af7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.249748 Jul 18 16:55:02.965913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 242/477] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:02 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:03.017920 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-334db999-a7e9-4871-9013-cf4e974c2c11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:03.027896 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-334db999-a7e9-4871-9013-cf4e974c2c11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.258991 Jul 18 16:55:03.028771 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 236/478] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:02 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:03.984345 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a3ba262a-8d67-46fa-a72c-5e33ccd56386 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:03.985379 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a3ba262a-8d67-46fa-a72c-5e33ccd56386 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:03.992377 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a3ba262a-8d67-46fa-a72c-5e33ccd56386 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:03.992974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a3ba262a-8d67-46fa-a72c-5e33ccd56386 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:03.993904 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a3ba262a-8d67-46fa-a72c-5e33ccd56386 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:03.994410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a3ba262a-8d67-46fa-a72c-5e33ccd56386 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:04.048960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0b752353-0e73-4c47-9808-829f294b882f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:04.050445 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0b752353-0e73-4c47-9808-829f294b882f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:04.062661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:04.066691 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b752353-0e73-4c47-9808-829f294b882f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:04.067191 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b752353-0e73-4c47-9808-829f294b882f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:04.068261 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b752353-0e73-4c47-9808-829f294b882f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:04.068892 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b752353-0e73-4c47-9808-829f294b882f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:04.174160 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a3ba262a-8d67-46fa-a72c-5e33ccd56386 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:04.185091 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a3ba262a-8d67-46fa-a72c-5e33ccd56386 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:04.195471 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a3ba262a-8d67-46fa-a72c-5e33ccd56386 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:04.197450 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a3ba262a-8d67-46fa-a72c-5e33ccd56386 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1746 microversion: 2.20 time: 0.217820 Jul 18 16:55:04.209659 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 243/479] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:03 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1746 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:04.267590 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-2b6ff11a-0a69-438d-ab7b-de97588cf4c3 req-7971bfac-aa77-4f13-9744-b4feee8290f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11140d5e-70e4-4716-ac6c-cef98b91640c", "tag": "bfb84bf6-a98e-4f78-9794-d40806a09eb5"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:04.281329 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-2b6ff11a-0a69-438d-ab7b-de97588cf4c3 req-7971bfac-aa77-4f13-9744-b4feee8290f0 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:04.284853 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-2b6ff11a-0a69-438d-ab7b-de97588cf4c3 req-7971bfac-aa77-4f13-9744-b4feee8290f0 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:04.308202 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-2b6ff11a-0a69-438d-ab7b-de97588cf4c3 req-7971bfac-aa77-4f13-9744-b4feee8290f0 service nova] Creating event network-changed:bfb84bf6-a98e-4f78-9794-d40806a09eb5 for instance 11140d5e-70e4-4716-ac6c-cef98b91640c on hv-cinder-83754 Jul 18 16:55:04.321396 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-2b6ff11a-0a69-438d-ab7b-de97588cf4c3 req-7971bfac-aa77-4f13-9744-b4feee8290f0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058494 Jul 18 16:55:04.329428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 244/480] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:55:04.440481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0b752353-0e73-4c47-9808-829f294b882f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:04.461075 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0b752353-0e73-4c47-9808-829f294b882f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.418909 Jul 18 16:55:04.462205 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 237/481] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:04 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:05.218589 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-754ab352-e458-40fe-b355-5c1111074fe5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:05.220756 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-754ab352-e458-40fe-b355-5c1111074fe5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:05.239222 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-754ab352-e458-40fe-b355-5c1111074fe5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:05.239222 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-754ab352-e458-40fe-b355-5c1111074fe5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:05.239222 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-754ab352-e458-40fe-b355-5c1111074fe5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:05.239222 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-754ab352-e458-40fe-b355-5c1111074fe5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:05.486580 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-754ab352-e458-40fe-b355-5c1111074fe5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:05.493543 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b359dbf0-7fd4-4e55-828e-796571a89ab5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:05.494797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b359dbf0-7fd4-4e55-828e-796571a89ab5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:05.495970 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-754ab352-e458-40fe-b355-5c1111074fe5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:05.500300 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-754ab352-e458-40fe-b355-5c1111074fe5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:05.504680 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-754ab352-e458-40fe-b355-5c1111074fe5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1746 microversion: 2.20 time: 0.291063 Jul 18 16:55:05.510339 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b359dbf0-7fd4-4e55-828e-796571a89ab5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:05.511576 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b359dbf0-7fd4-4e55-828e-796571a89ab5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:05.513423 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b359dbf0-7fd4-4e55-828e-796571a89ab5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:05.514493 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b359dbf0-7fd4-4e55-828e-796571a89ab5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:05.525512 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 245/482] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:05 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1746 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:05.825821 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b359dbf0-7fd4-4e55-828e-796571a89ab5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:05.842032 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b359dbf0-7fd4-4e55-828e-796571a89ab5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.363695 Jul 18 16:55:05.843160 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 238/483] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:05 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:06.426786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-b75de062-21c1-4d1d-93da-dd56d67ef042 req-463acb22-46f8-44e7-ba02-18c153661807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d31815-4f8c-4e76-adcb-8039b88488d0", "name": "network-vif-plugged", "status": "completed", "tag": "cbb20d80-19a9-48b1-be96-866c4a0904d4"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:06.436259 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-b75de062-21c1-4d1d-93da-dd56d67ef042 req-463acb22-46f8-44e7-ba02-18c153661807 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:06.437133 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-b75de062-21c1-4d1d-93da-dd56d67ef042 req-463acb22-46f8-44e7-ba02-18c153661807 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:06.448589 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-b75de062-21c1-4d1d-93da-dd56d67ef042 req-463acb22-46f8-44e7-ba02-18c153661807 service nova] Creating event network-vif-plugged:cbb20d80-19a9-48b1-be96-866c4a0904d4 for instance c3d31815-4f8c-4e76-adcb-8039b88488d0 on hv-cinder-83754 Jul 18 16:55:06.454161 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-b75de062-21c1-4d1d-93da-dd56d67ef042 req-463acb22-46f8-44e7-ba02-18c153661807 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031142 Jul 18 16:55:06.454746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 246/484] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:06.531762 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a347da4c-b302-450b-9708-403cb5bd834c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:06.532391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a347da4c-b302-450b-9708-403cb5bd834c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:06.538583 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a347da4c-b302-450b-9708-403cb5bd834c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:06.539031 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a347da4c-b302-450b-9708-403cb5bd834c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:06.539808 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a347da4c-b302-450b-9708-403cb5bd834c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:06.540268 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a347da4c-b302-450b-9708-403cb5bd834c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:06.699329 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a347da4c-b302-450b-9708-403cb5bd834c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:06.708382 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a347da4c-b302-450b-9708-403cb5bd834c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:06.710013 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a347da4c-b302-450b-9708-403cb5bd834c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:06.711181 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a347da4c-b302-450b-9708-403cb5bd834c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1746 microversion: 2.20 time: 0.184315 Jul 18 16:55:06.711734 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 239/485] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:06 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1746 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:06.860100 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1d64c483-4613-4c4e-b21f-6285aee4d02c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:06.860983 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1d64c483-4613-4c4e-b21f-6285aee4d02c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:06.868373 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d64c483-4613-4c4e-b21f-6285aee4d02c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:06.870508 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d64c483-4613-4c4e-b21f-6285aee4d02c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:06.870508 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d64c483-4613-4c4e-b21f-6285aee4d02c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:06.870508 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d64c483-4613-4c4e-b21f-6285aee4d02c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:06.908175 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1e74c7da-da05-464a-9333-e8b5c6d6ad36 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:06.908847 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1e74c7da-da05-464a-9333-e8b5c6d6ad36 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:06.915055 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1e74c7da-da05-464a-9333-e8b5c6d6ad36 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:06.915646 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1e74c7da-da05-464a-9333-e8b5c6d6ad36 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:06.916495 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1e74c7da-da05-464a-9333-e8b5c6d6ad36 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:06.917003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1e74c7da-da05-464a-9333-e8b5c6d6ad36 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:06.946903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1e74c7da-da05-464a-9333-e8b5c6d6ad36 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/ips" status: 200 len: 149 microversion: 2.1 time: 0.042961 Jul 18 16:55:06.956853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 240/486] 10.222.0.76 () {58 vars in 1247 bytes} [Mon Jul 18 16:55:06 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/ips => generated 149 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:55:07.027002 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1d64c483-4613-4c4e-b21f-6285aee4d02c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:07.037479 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1d64c483-4613-4c4e-b21f-6285aee4d02c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.182237 Jul 18 16:55:07.044827 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 247/487] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:06 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:07.732547 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-af503956-ce53-4f63-a982-936277e19cd1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:07.735756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-af503956-ce53-4f63-a982-936277e19cd1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:07.746383 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af503956-ce53-4f63-a982-936277e19cd1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:07.746989 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af503956-ce53-4f63-a982-936277e19cd1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:07.747770 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af503956-ce53-4f63-a982-936277e19cd1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:07.748445 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af503956-ce53-4f63-a982-936277e19cd1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:08.054634 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2ea40933-d047-497e-8afc-850830de42bc tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:08.056430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2ea40933-d047-497e-8afc-850830de42bc tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:08.068986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ea40933-d047-497e-8afc-850830de42bc tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:08.069729 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ea40933-d047-497e-8afc-850830de42bc tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:08.070808 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ea40933-d047-497e-8afc-850830de42bc tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:08.071440 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ea40933-d047-497e-8afc-850830de42bc tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:08.092903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-af503956-ce53-4f63-a982-936277e19cd1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:08.094245 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:08.107383 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-af503956-ce53-4f63-a982-936277e19cd1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:08.110369 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-af503956-ce53-4f63-a982-936277e19cd1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:08.111891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-af503956-ce53-4f63-a982-936277e19cd1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1746 microversion: 2.20 time: 0.384292 Jul 18 16:55:08.124999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 241/488] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:07 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1746 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:55:08.336951 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2ea40933-d047-497e-8afc-850830de42bc tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:08.351643 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2ea40933-d047-497e-8afc-850830de42bc tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.301174 Jul 18 16:55:08.367704 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 248/489] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:08 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:09.132282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-88d32d27-1d57-4c5f-9416-d360c2809fbd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:09.133739 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-88d32d27-1d57-4c5f-9416-d360c2809fbd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:09.145918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88d32d27-1d57-4c5f-9416-d360c2809fbd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:09.146382 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88d32d27-1d57-4c5f-9416-d360c2809fbd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:09.147190 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88d32d27-1d57-4c5f-9416-d360c2809fbd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:09.147635 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88d32d27-1d57-4c5f-9416-d360c2809fbd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:09.370803 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-174b5957-ef99-403c-9c04-448284c7d407 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:09.372146 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-174b5957-ef99-403c-9c04-448284c7d407 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:09.381733 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-174b5957-ef99-403c-9c04-448284c7d407 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:09.382498 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-174b5957-ef99-403c-9c04-448284c7d407 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:09.383472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-174b5957-ef99-403c-9c04-448284c7d407 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:09.384854 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-174b5957-ef99-403c-9c04-448284c7d407 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:09.427389 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-88d32d27-1d57-4c5f-9416-d360c2809fbd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:09.442159 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-88d32d27-1d57-4c5f-9416-d360c2809fbd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:09.456941 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-88d32d27-1d57-4c5f-9416-d360c2809fbd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:09.456941 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-88d32d27-1d57-4c5f-9416-d360c2809fbd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1746 microversion: 2.20 time: 0.317189 Jul 18 16:55:09.456941 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 242/490] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:09 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1746 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:09.586949 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-174b5957-ef99-403c-9c04-448284c7d407 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:09.598613 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-174b5957-ef99-403c-9c04-448284c7d407 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.232069 Jul 18 16:55:09.599803 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 249/491] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:09 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:10.019096 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f2d1cd3f-00b3-4543-90c9-082f2b0b1433 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48968069-af81-48e8-ab60-6562f51bb0bd"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:10.020572 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f2d1cd3f-00b3-4543-90c9-082f2b0b1433 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:10.027832 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2d1cd3f-00b3-4543-90c9-082f2b0b1433 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:10.028287 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2d1cd3f-00b3-4543-90c9-082f2b0b1433 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:10.029095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2d1cd3f-00b3-4543-90c9-082f2b0b1433 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:10.029572 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2d1cd3f-00b3-4543-90c9-082f2b0b1433 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:10.319292 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:10.473280 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-03a9db25-6430-4a31-8e4e-a20f5c4962c1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:10.478972 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-03a9db25-6430-4a31-8e4e-a20f5c4962c1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:10.488553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-03a9db25-6430-4a31-8e4e-a20f5c4962c1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:10.489138 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-03a9db25-6430-4a31-8e4e-a20f5c4962c1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:10.490331 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-03a9db25-6430-4a31-8e4e-a20f5c4962c1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:10.490945 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-03a9db25-6430-4a31-8e4e-a20f5c4962c1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:10.659019 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-03a9db25-6430-4a31-8e4e-a20f5c4962c1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:10.667791 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-03a9db25-6430-4a31-8e4e-a20f5c4962c1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:10.672035 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-03a9db25-6430-4a31-8e4e-a20f5c4962c1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:10.673813 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-03a9db25-6430-4a31-8e4e-a20f5c4962c1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1746 microversion: 2.20 time: 0.210545 Jul 18 16:55:10.674453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 250/492] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:10 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1746 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:10.685274 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6e5c7816-020f-44e6-9161-18e25d09636f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:10.685985 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6e5c7816-020f-44e6-9161-18e25d09636f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:10.694217 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e5c7816-020f-44e6-9161-18e25d09636f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:10.694761 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e5c7816-020f-44e6-9161-18e25d09636f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:10.695605 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e5c7816-020f-44e6-9161-18e25d09636f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:10.696194 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e5c7816-020f-44e6-9161-18e25d09636f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:10.884308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6e5c7816-020f-44e6-9161-18e25d09636f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:10.884308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6e5c7816-020f-44e6-9161-18e25d09636f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.200190 Jul 18 16:55:10.884308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 251/493] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:10 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:11.227619 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f2d1cd3f-00b3-4543-90c9-082f2b0b1433 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "POST /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.213861 Jul 18 16:55:11.241362 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 243/494] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 16:55:10 2022] POST /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-volume_attachments => generated 194 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:11.691901 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3b0d11df-1168-4396-a566-aca196af09aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:11.694074 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3b0d11df-1168-4396-a566-aca196af09aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:11.703693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3b0d11df-1168-4396-a566-aca196af09aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:11.704531 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3b0d11df-1168-4396-a566-aca196af09aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:11.706250 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3b0d11df-1168-4396-a566-aca196af09aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:11.706929 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3b0d11df-1168-4396-a566-aca196af09aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:11.883107 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3b0d11df-1168-4396-a566-aca196af09aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:11.895643 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3b0d11df-1168-4396-a566-aca196af09aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:11.897573 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3b0d11df-1168-4396-a566-aca196af09aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:11.899265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3b0d11df-1168-4396-a566-aca196af09aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1746 microversion: 2.20 time: 0.211288 Jul 18 16:55:11.899393 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-23ed4e2c-6fd8-46e2-9b6c-9212a7a4f0d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:11.900303 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-23ed4e2c-6fd8-46e2-9b6c-9212a7a4f0d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:11.901359 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 252/495] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:11 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1746 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:11.907293 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23ed4e2c-6fd8-46e2-9b6c-9212a7a4f0d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:11.907752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23ed4e2c-6fd8-46e2-9b6c-9212a7a4f0d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:11.908579 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23ed4e2c-6fd8-46e2-9b6c-9212a7a4f0d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:11.909038 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23ed4e2c-6fd8-46e2-9b6c-9212a7a4f0d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:12.174159 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-7febd4f4-0013-438f-8070-1354f39bda07 req-04330771-76a4-416d-be9e-017970d3b41a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d25fa4-9505-4471-a0be-e3a486297f2d", "name": "network-vif-plugged", "status": "completed", "tag": "f3c39284-35e1-4778-990a-0024c4b94641"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:12.189759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-7febd4f4-0013-438f-8070-1354f39bda07 req-04330771-76a4-416d-be9e-017970d3b41a service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:12.190428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-7febd4f4-0013-438f-8070-1354f39bda07 req-04330771-76a4-416d-be9e-017970d3b41a service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:12.205217 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-7febd4f4-0013-438f-8070-1354f39bda07 req-04330771-76a4-416d-be9e-017970d3b41a service nova] Creating event network-vif-plugged:f3c39284-35e1-4778-990a-0024c4b94641 for instance 87d25fa4-9505-4471-a0be-e3a486297f2d on hv-cinder-83754 Jul 18 16:55:12.209751 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-23ed4e2c-6fd8-46e2-9b6c-9212a7a4f0d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:12.219513 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-23ed4e2c-6fd8-46e2-9b6c-9212a7a4f0d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.326237 Jul 18 16:55:12.220452 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-7febd4f4-0013-438f-8070-1354f39bda07 req-04330771-76a4-416d-be9e-017970d3b41a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045155 Jul 18 16:55:12.221929 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 253/496] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:55:12.224455 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 244/497] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:11 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:12.920533 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-08294e6f-21cd-4d8a-b31d-b42ff53a4004 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:12.926836 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-08294e6f-21cd-4d8a-b31d-b42ff53a4004 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:12.930705 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-08294e6f-21cd-4d8a-b31d-b42ff53a4004 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:12.931430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-08294e6f-21cd-4d8a-b31d-b42ff53a4004 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:12.932469 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-08294e6f-21cd-4d8a-b31d-b42ff53a4004 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:12.933180 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-08294e6f-21cd-4d8a-b31d-b42ff53a4004 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:13.210848 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-08294e6f-21cd-4d8a-b31d-b42ff53a4004 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:13.223109 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-08294e6f-21cd-4d8a-b31d-b42ff53a4004 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:13.225405 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-08294e6f-21cd-4d8a-b31d-b42ff53a4004 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:13.228258 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-08294e6f-21cd-4d8a-b31d-b42ff53a4004 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1741 microversion: 2.20 time: 0.311971 Jul 18 16:55:13.241743 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ddc0898a-74e8-4889-9e8c-9c7959e6a419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:13.243615 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ddc0898a-74e8-4889-9e8c-9c7959e6a419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:13.260346 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 254/498] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:12 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1741 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:13.262475 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddc0898a-74e8-4889-9e8c-9c7959e6a419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:13.264169 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddc0898a-74e8-4889-9e8c-9c7959e6a419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:13.267011 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddc0898a-74e8-4889-9e8c-9c7959e6a419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:13.285039 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddc0898a-74e8-4889-9e8c-9c7959e6a419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:13.646410 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ddc0898a-74e8-4889-9e8c-9c7959e6a419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:13.659946 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ddc0898a-74e8-4889-9e8c-9c7959e6a419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.422430 Jul 18 16:55:13.673117 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 245/499] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:13 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:14.259891 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6bc6a867-770b-49f9-9c2d-58cfb5fadb81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:14.261718 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6bc6a867-770b-49f9-9c2d-58cfb5fadb81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:14.277367 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6bc6a867-770b-49f9-9c2d-58cfb5fadb81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:14.277823 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6bc6a867-770b-49f9-9c2d-58cfb5fadb81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:14.278607 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6bc6a867-770b-49f9-9c2d-58cfb5fadb81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:14.306949 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6bc6a867-770b-49f9-9c2d-58cfb5fadb81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:14.540239 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6bc6a867-770b-49f9-9c2d-58cfb5fadb81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:14.552735 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6bc6a867-770b-49f9-9c2d-58cfb5fadb81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:14.554327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6bc6a867-770b-49f9-9c2d-58cfb5fadb81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:14.557907 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6bc6a867-770b-49f9-9c2d-58cfb5fadb81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1741 microversion: 2.20 time: 0.301605 Jul 18 16:55:14.557907 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 255/500] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:14 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:14.686082 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e3899fbc-4858-491f-9e98-d3ed3fcacd07 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:14.686996 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e3899fbc-4858-491f-9e98-d3ed3fcacd07 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:14.695008 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e3899fbc-4858-491f-9e98-d3ed3fcacd07 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:14.695457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e3899fbc-4858-491f-9e98-d3ed3fcacd07 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:14.696264 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e3899fbc-4858-491f-9e98-d3ed3fcacd07 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:14.696698 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e3899fbc-4858-491f-9e98-d3ed3fcacd07 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:14.944909 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e3899fbc-4858-491f-9e98-d3ed3fcacd07 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:14.953992 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e3899fbc-4858-491f-9e98-d3ed3fcacd07 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1261 microversion: 2.1 time: 0.271936 Jul 18 16:55:14.955927 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 246/501] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:14 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1261 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:15.582733 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aafacde1-3022-4b1c-9a3c-bb8d3d7a6e72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:15.584311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aafacde1-3022-4b1c-9a3c-bb8d3d7a6e72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:15.615794 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aafacde1-3022-4b1c-9a3c-bb8d3d7a6e72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:15.620121 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aafacde1-3022-4b1c-9a3c-bb8d3d7a6e72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:15.622080 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aafacde1-3022-4b1c-9a3c-bb8d3d7a6e72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:15.628232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aafacde1-3022-4b1c-9a3c-bb8d3d7a6e72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:15.879663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aafacde1-3022-4b1c-9a3c-bb8d3d7a6e72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:15.921317 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aafacde1-3022-4b1c-9a3c-bb8d3d7a6e72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:15.921317 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aafacde1-3022-4b1c-9a3c-bb8d3d7a6e72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:15.921317 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aafacde1-3022-4b1c-9a3c-bb8d3d7a6e72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1741 microversion: 2.20 time: 0.322389 Jul 18 16:55:15.921874 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 256/502] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:15 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1741 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:15.973044 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-46d8c1bc-d6d8-4593-b51a-66ff9cf38b0d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:15.974414 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-46d8c1bc-d6d8-4593-b51a-66ff9cf38b0d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:15.996515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46d8c1bc-d6d8-4593-b51a-66ff9cf38b0d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:16.000202 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46d8c1bc-d6d8-4593-b51a-66ff9cf38b0d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:16.009181 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46d8c1bc-d6d8-4593-b51a-66ff9cf38b0d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:16.009751 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46d8c1bc-d6d8-4593-b51a-66ff9cf38b0d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:16.377996 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-46d8c1bc-d6d8-4593-b51a-66ff9cf38b0d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:16.392307 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-46d8c1bc-d6d8-4593-b51a-66ff9cf38b0d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1443 microversion: 2.1 time: 0.421034 Jul 18 16:55:16.394506 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 247/503] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:15 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1443 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:16.417518 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dae14760-9436-41ea-8664-70852efef541 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:16.418582 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dae14760-9436-41ea-8664-70852efef541 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:16.425958 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dae14760-9436-41ea-8664-70852efef541 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:16.426253 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dae14760-9436-41ea-8664-70852efef541 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:16.431725 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dae14760-9436-41ea-8664-70852efef541 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:16.432484 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dae14760-9436-41ea-8664-70852efef541 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:16.704602 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dae14760-9436-41ea-8664-70852efef541 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:16.715160 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dae14760-9436-41ea-8664-70852efef541 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1443 microversion: 2.1 time: 0.301549 Jul 18 16:55:16.716004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 257/504] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:16 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1443 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:16.943489 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c334e62d-8f43-45df-bb0e-0bdbfb6aee15 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:16.944109 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c334e62d-8f43-45df-bb0e-0bdbfb6aee15 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:16.956506 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c334e62d-8f43-45df-bb0e-0bdbfb6aee15 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:16.956953 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c334e62d-8f43-45df-bb0e-0bdbfb6aee15 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:16.965942 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c334e62d-8f43-45df-bb0e-0bdbfb6aee15 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:16.966697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c334e62d-8f43-45df-bb0e-0bdbfb6aee15 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:17.294415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c334e62d-8f43-45df-bb0e-0bdbfb6aee15 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:17.311046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c334e62d-8f43-45df-bb0e-0bdbfb6aee15 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:17.313667 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c334e62d-8f43-45df-bb0e-0bdbfb6aee15 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:17.315539 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c334e62d-8f43-45df-bb0e-0bdbfb6aee15 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1741 microversion: 2.20 time: 0.380274 Jul 18 16:55:17.317382 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 248/505] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:16 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1741 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:18.335770 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4bb1cf6e-bb06-4f82-af18-7bc19443f782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:18.336370 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4bb1cf6e-bb06-4f82-af18-7bc19443f782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:18.354024 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=78 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:18.355663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4bb1cf6e-bb06-4f82-af18-7bc19443f782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:18.356118 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4bb1cf6e-bb06-4f82-af18-7bc19443f782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:18.356928 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4bb1cf6e-bb06-4f82-af18-7bc19443f782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:18.357468 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4bb1cf6e-bb06-4f82-af18-7bc19443f782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:19.064533 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4bb1cf6e-bb06-4f82-af18-7bc19443f782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:19.098759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4bb1cf6e-bb06-4f82-af18-7bc19443f782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:19.098759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4bb1cf6e-bb06-4f82-af18-7bc19443f782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:19.098759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4bb1cf6e-bb06-4f82-af18-7bc19443f782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1741 microversion: 2.20 time: 0.759606 Jul 18 16:55:19.125056 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 258/506] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:18 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1741 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:20.121990 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-de6559b3-80eb-47f8-91ab-96fb61a8cb63 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:20.125279 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-de6559b3-80eb-47f8-91ab-96fb61a8cb63 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:20.149899 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de6559b3-80eb-47f8-91ab-96fb61a8cb63 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:20.150785 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de6559b3-80eb-47f8-91ab-96fb61a8cb63 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:20.152546 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de6559b3-80eb-47f8-91ab-96fb61a8cb63 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:20.154559 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de6559b3-80eb-47f8-91ab-96fb61a8cb63 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:20.373267 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c19dd1d6-0340-4a3a-adb0-fc890a6fbe31 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Action: 'create', calling method: .version_select at 0x7f4af1721790>, body: {"keypair": {"name": "tempest-keypair-1149494143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5UFq1fboBgttZozmMlfZZhJjUPArBUFo9/Pw7p2h5RAAw4zFqNxX1N8sSGGlJuvd817/1RLbB7RRWq4SB4pSnjdAk1dP0eD3BGw4/uUutrEPIdQlSRU4+jVbKdQJw6Kw=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:20.415671 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-c19dd1d6-0340-4a3a-adb0-fc890a6fbe31 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for project 4f82344d2255427582cc29e253b37f0b. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:55:20.428655 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-c19dd1d6-0340-4a3a-adb0-fc890a6fbe31 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for user 0cf277a2d03443c8af7a7bee2731d9d1 and project 4f82344d2255427582cc29e253b37f0b. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:55:20.480161 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-de6559b3-80eb-47f8-91ab-96fb61a8cb63 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:20.494646 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-de6559b3-80eb-47f8-91ab-96fb61a8cb63 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:20.496861 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-de6559b3-80eb-47f8-91ab-96fb61a8cb63 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:20.499571 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-de6559b3-80eb-47f8-91ab-96fb61a8cb63 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1741 microversion: 2.20 time: 0.392462 Jul 18 16:55:20.501209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 249/507] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:20 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1741 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:20.671969 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c19dd1d6-0340-4a3a-adb0-fc890a6fbe31 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.302778 Jul 18 16:55:20.672686 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 259/508] 10.222.0.76 () {60 vars in 1158 bytes} [Mon Jul 18 16:55:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:55:21.520791 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-85a90ff2-414a-4029-a142-4fc4d488a173 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:21.522330 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-85a90ff2-414a-4029-a142-4fc4d488a173 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:21.535204 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-85a90ff2-414a-4029-a142-4fc4d488a173 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:21.536015 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-85a90ff2-414a-4029-a142-4fc4d488a173 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:21.537797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-85a90ff2-414a-4029-a142-4fc4d488a173 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:21.538542 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-85a90ff2-414a-4029-a142-4fc4d488a173 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:21.653406 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-45fd307e-f771-4b3e-956f-2f390c7b0088 req-08e6c7f5-6c8d-4308-a655-be96d980cb12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d25fa4-9505-4471-a0be-e3a486297f2d", "tag": "f3c39284-35e1-4778-990a-0024c4b94641"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:21.694030 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-45fd307e-f771-4b3e-956f-2f390c7b0088 req-08e6c7f5-6c8d-4308-a655-be96d980cb12 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:21.694490 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-45fd307e-f771-4b3e-956f-2f390c7b0088 req-08e6c7f5-6c8d-4308-a655-be96d980cb12 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:21.734810 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-45fd307e-f771-4b3e-956f-2f390c7b0088 req-08e6c7f5-6c8d-4308-a655-be96d980cb12 service nova] Creating event network-changed:f3c39284-35e1-4778-990a-0024c4b94641 for instance 87d25fa4-9505-4471-a0be-e3a486297f2d on hv-cinder-83754 Jul 18 16:55:21.741044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-45fd307e-f771-4b3e-956f-2f390c7b0088 req-08e6c7f5-6c8d-4308-a655-be96d980cb12 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091624 Jul 18 16:55:21.742182 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 260/509] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:21.755575 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-85a90ff2-414a-4029-a142-4fc4d488a173 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:21.768362 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-85a90ff2-414a-4029-a142-4fc4d488a173 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:21.770368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-85a90ff2-414a-4029-a142-4fc4d488a173 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:21.771736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-85a90ff2-414a-4029-a142-4fc4d488a173 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1741 microversion: 2.20 time: 0.255872 Jul 18 16:55:21.772769 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 250/510] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:21 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1741 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:22.790508 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3815b0df-adf3-49b6-bb70-f030ad163559 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:22.791246 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3815b0df-adf3-49b6-bb70-f030ad163559 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:22.806205 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3815b0df-adf3-49b6-bb70-f030ad163559 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:22.806665 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3815b0df-adf3-49b6-bb70-f030ad163559 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:22.807470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3815b0df-adf3-49b6-bb70-f030ad163559 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:22.807916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3815b0df-adf3-49b6-bb70-f030ad163559 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:23.134789 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3815b0df-adf3-49b6-bb70-f030ad163559 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:23.146323 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3815b0df-adf3-49b6-bb70-f030ad163559 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:23.148090 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3815b0df-adf3-49b6-bb70-f030ad163559 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:23.149423 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3815b0df-adf3-49b6-bb70-f030ad163559 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1741 microversion: 2.20 time: 0.363152 Jul 18 16:55:23.150148 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 261/511] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:22 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1741 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:24.175134 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a8124814-04f5-409a-97f5-fca6ac0989cf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:24.175697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a8124814-04f5-409a-97f5-fca6ac0989cf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:24.189483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8124814-04f5-409a-97f5-fca6ac0989cf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:24.190134 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8124814-04f5-409a-97f5-fca6ac0989cf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:24.193086 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8124814-04f5-409a-97f5-fca6ac0989cf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:24.193770 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8124814-04f5-409a-97f5-fca6ac0989cf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:24.476856 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a8124814-04f5-409a-97f5-fca6ac0989cf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:24.497415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a8124814-04f5-409a-97f5-fca6ac0989cf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:24.506344 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a8124814-04f5-409a-97f5-fca6ac0989cf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:24.508041 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a8124814-04f5-409a-97f5-fca6ac0989cf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1741 microversion: 2.20 time: 0.344065 Jul 18 16:55:24.515550 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 251/512] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:24 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1741 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:25.340629 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-705209564", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae3a9cc1-1c89-413a-9dc0-c337425ad213"}], "security_groups": [{"name": "tempest-securitygroup--1850124396"}], "key_name": "tempest-keypair-1149494143", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:25.532415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-32efbd15-942f-4592-b308-0bfb9d32c20f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:25.533049 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-32efbd15-942f-4592-b308-0bfb9d32c20f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:25.539644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-32efbd15-942f-4592-b308-0bfb9d32c20f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:25.540098 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-32efbd15-942f-4592-b308-0bfb9d32c20f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:25.540873 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-32efbd15-942f-4592-b308-0bfb9d32c20f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:25.541338 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-32efbd15-942f-4592-b308-0bfb9d32c20f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:25.709448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-32efbd15-942f-4592-b308-0bfb9d32c20f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:25.717410 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-32efbd15-942f-4592-b308-0bfb9d32c20f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:25.718924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-32efbd15-942f-4592-b308-0bfb9d32c20f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:25.720088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-32efbd15-942f-4592-b308-0bfb9d32c20f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1741 microversion: 2.20 time: 0.192154 Jul 18 16:55:25.732877 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 252/513] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:25 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:55:26.742674 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c709a2ee-a5f1-4e7d-b141-3eab87425c6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:26.743341 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c709a2ee-a5f1-4e7d-b141-3eab87425c6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:26.750437 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c709a2ee-a5f1-4e7d-b141-3eab87425c6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:26.750891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c709a2ee-a5f1-4e7d-b141-3eab87425c6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:26.751668 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c709a2ee-a5f1-4e7d-b141-3eab87425c6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:26.752116 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c709a2ee-a5f1-4e7d-b141-3eab87425c6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:26.888599 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c709a2ee-a5f1-4e7d-b141-3eab87425c6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:26.897366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c709a2ee-a5f1-4e7d-b141-3eab87425c6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:26.898854 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c709a2ee-a5f1-4e7d-b141-3eab87425c6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:26.900000 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c709a2ee-a5f1-4e7d-b141-3eab87425c6e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1741 microversion: 2.20 time: 0.163465 Jul 18 16:55:26.900551 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 253/514] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:26 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:55:27.918523 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c7e9e5bc-438d-45e4-8251-6149180367fd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:27.919150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c7e9e5bc-438d-45e4-8251-6149180367fd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:27.926903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c7e9e5bc-438d-45e4-8251-6149180367fd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:27.927476 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c7e9e5bc-438d-45e4-8251-6149180367fd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:27.928265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c7e9e5bc-438d-45e4-8251-6149180367fd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:27.928721 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c7e9e5bc-438d-45e4-8251-6149180367fd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:28.082396 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c7e9e5bc-438d-45e4-8251-6149180367fd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:28.091248 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c7e9e5bc-438d-45e4-8251-6149180367fd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:28.093711 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c7e9e5bc-438d-45e4-8251-6149180367fd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:28.095369 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c7e9e5bc-438d-45e4-8251-6149180367fd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1741 microversion: 2.20 time: 0.180845 Jul 18 16:55:28.096348 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 254/515] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:27 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:28.584236 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] validate_networks() for [('ae3a9cc1-1c89-413a-9dc0-c337425ad213', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:55:29.069207 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:55:29.070213 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:55:29.070923 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:55:29.071346 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:55:29.071765 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:55:29.082578 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:29.083470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:29.085661 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:29.085661 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:29.106012 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for project 4f82344d2255427582cc29e253b37f0b. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:55:29.110674 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for user 0cf277a2d03443c8af7a7bee2731d9d1 and project 4f82344d2255427582cc29e253b37f0b. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:55:29.113885 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b44fa644-6531-47da-9c89-30217eb61ab5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:29.115237 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b44fa644-6531-47da-9c89-30217eb61ab5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:29.122498 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b44fa644-6531-47da-9c89-30217eb61ab5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:29.123279 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b44fa644-6531-47da-9c89-30217eb61ab5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:29.124326 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b44fa644-6531-47da-9c89-30217eb61ab5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:29.124976 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b44fa644-6531-47da-9c89-30217eb61ab5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:29.125630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:55:29.127915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:55:29.276724 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b44fa644-6531-47da-9c89-30217eb61ab5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:29.288212 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b44fa644-6531-47da-9c89-30217eb61ab5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:29.289966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b44fa644-6531-47da-9c89-30217eb61ab5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:29.291384 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b44fa644-6531-47da-9c89-30217eb61ab5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1741 microversion: 2.20 time: 0.182199 Jul 18 16:55:29.292521 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 255/516] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:29 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:29.302771 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-175ff279-ea89-46ad-b7c6-21954363ea0c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.967031 Jul 18 16:55:29.308528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 262/517] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:55:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 3973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:55:29.320145 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f48d0743-3c05-48aa-84d0-621e00787069 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:29.320759 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f48d0743-3c05-48aa-84d0-621e00787069 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:29.410576 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f48d0743-3c05-48aa-84d0-621e00787069 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:29.418461 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f48d0743-3c05-48aa-84d0-621e00787069 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1241 microversion: 2.1 time: 0.104623 Jul 18 16:55:29.429264 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 256/518] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:29 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:30.311443 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7e16562a-01ef-42d6-9439-0da060bb3658 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:30.312001 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7e16562a-01ef-42d6-9439-0da060bb3658 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:30.318951 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e16562a-01ef-42d6-9439-0da060bb3658 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:30.319412 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e16562a-01ef-42d6-9439-0da060bb3658 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:30.320182 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e16562a-01ef-42d6-9439-0da060bb3658 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:30.320623 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e16562a-01ef-42d6-9439-0da060bb3658 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:30.435741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4aed4989-c1f4-4ebd-9b3f-4757255a395c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:30.436412 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4aed4989-c1f4-4ebd-9b3f-4757255a395c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:30.472996 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7e16562a-01ef-42d6-9439-0da060bb3658 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:30.482803 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7e16562a-01ef-42d6-9439-0da060bb3658 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:30.485739 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7e16562a-01ef-42d6-9439-0da060bb3658 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:30.486974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7e16562a-01ef-42d6-9439-0da060bb3658 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1723 microversion: 2.20 time: 0.180086 Jul 18 16:55:30.487541 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 263/519] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:30 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:30.740172 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4aed4989-c1f4-4ebd-9b3f-4757255a395c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:30.752232 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4aed4989-c1f4-4ebd-9b3f-4757255a395c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1241 microversion: 2.1 time: 0.320145 Jul 18 16:55:30.753245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 257/520] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:30 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1241 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:31.506604 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-159d1b00-d29d-41b6-a824-b97eaaa61c94 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:31.507235 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-159d1b00-d29d-41b6-a824-b97eaaa61c94 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:31.513748 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-159d1b00-d29d-41b6-a824-b97eaaa61c94 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:31.514353 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-159d1b00-d29d-41b6-a824-b97eaaa61c94 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:31.515177 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-159d1b00-d29d-41b6-a824-b97eaaa61c94 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:31.515756 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-159d1b00-d29d-41b6-a824-b97eaaa61c94 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:31.652835 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-159d1b00-d29d-41b6-a824-b97eaaa61c94 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:31.656685 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7656527c-c5d4-442c-893b-b1476a44792f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Action: 'create', calling method: .version_select at 0x7f4af170cb80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1119680420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODcWeSKk4gSjYZSj67G69oFp5VGhuVMIPZWU9H8eZFbQqnEZdDUobBGSI6f1on9hT5vCeWarX3rRpj8mjl4mI4LJCkI50fMNmBJbgk5nA80PbmLrQwLU0srgXCzDwtxaA=="}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:31.663311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-159d1b00-d29d-41b6-a824-b97eaaa61c94 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:31.664908 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-159d1b00-d29d-41b6-a824-b97eaaa61c94 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:31.666361 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-159d1b00-d29d-41b6-a824-b97eaaa61c94 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1723 microversion: 2.20 time: 0.163859 Jul 18 16:55:31.667317 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 264/521] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:31 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:31.675736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-7656527c-c5d4-442c-893b-b1476a44792f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Getting quotas for project fbde8a43b24043e1bbab860fcbe67c91. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:55:31.680342 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-7656527c-c5d4-442c-893b-b1476a44792f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Getting quotas for user 71a82de7d125480a9f23c8cdf0c05638 and project fbde8a43b24043e1bbab860fcbe67c91. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:55:31.691335 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-2a0a690f-34bf-4f2e-a3eb-e1d473136609 req-429df721-1aa8-432f-9c4b-5abe40dc67da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d31815-4f8c-4e76-adcb-8039b88488d0", "name": "network-vif-unplugged", "status": "completed", "tag": "cbb20d80-19a9-48b1-be96-866c4a0904d4"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:31.700163 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-2a0a690f-34bf-4f2e-a3eb-e1d473136609 req-429df721-1aa8-432f-9c4b-5abe40dc67da service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:31.700610 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-2a0a690f-34bf-4f2e-a3eb-e1d473136609 req-429df721-1aa8-432f-9c4b-5abe40dc67da service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:31.713213 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-2a0a690f-34bf-4f2e-a3eb-e1d473136609 req-429df721-1aa8-432f-9c4b-5abe40dc67da service nova] Creating event network-vif-unplugged:cbb20d80-19a9-48b1-be96-866c4a0904d4 for instance c3d31815-4f8c-4e76-adcb-8039b88488d0 on hv-cinder-83754 Jul 18 16:55:31.721917 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-2a0a690f-34bf-4f2e-a3eb-e1d473136609 req-429df721-1aa8-432f-9c4b-5abe40dc67da service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033953 Jul 18 16:55:31.723635 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 265/522] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:55:31.770052 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8917861e-476c-48a7-9e67-6449ad5f77f5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:31.770764 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8917861e-476c-48a7-9e67-6449ad5f77f5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:31.777273 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8917861e-476c-48a7-9e67-6449ad5f77f5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:31.777733 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8917861e-476c-48a7-9e67-6449ad5f77f5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:31.778524 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8917861e-476c-48a7-9e67-6449ad5f77f5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:31.778974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8917861e-476c-48a7-9e67-6449ad5f77f5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:31.791882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7656527c-c5d4-442c-893b-b1476a44792f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.139998 Jul 18 16:55:31.792818 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 258/523] 10.222.0.76 () {60 vars in 1158 bytes} [Mon Jul 18 16:55:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:31.843853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-655251406", "imageRef": "b8bd5c55-4795-4d62-80ac-e4a53b9410a4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1119680420", "networks": [{"uuid": "6fe60edc-f376-491e-9749-c337273ba0b9"}]}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:31.857812 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8917861e-476c-48a7-9e67-6449ad5f77f5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:31.866499 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8917861e-476c-48a7-9e67-6449ad5f77f5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1245 microversion: 2.1 time: 0.100664 Jul 18 16:55:31.867061 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 266/524] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:31 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:31.894824 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] validate_networks() for [('6fe60edc-f376-491e-9749-c337273ba0b9', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:55:32.277939 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:55:32.278362 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:55:32.278878 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:55:32.279283 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:55:32.279727 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:55:32.289596 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:32.290068 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:32.290859 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:32.291291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:32.307733 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Getting quotas for project fbde8a43b24043e1bbab860fcbe67c91. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:55:32.312864 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Getting quotas for user 71a82de7d125480a9f23c8cdf0c05638 and project fbde8a43b24043e1bbab860fcbe67c91. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:55:32.324153 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:55:32.327258 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8bd5c55-4795-4d62-80ac-e4a53b9410a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:55:32.538003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ba7dea5e-dedb-4205-b0f0-847e6022d9c1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698413 Jul 18 16:55:32.538841 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 259/525] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:55:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:55:32.551363 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-66eb13c8-43b5-41e4-ab16-2b71610b34fd tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:32.554892 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-66eb13c8-43b5-41e4-ab16-2b71610b34fd tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:32.614193 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-66eb13c8-43b5-41e4-ab16-2b71610b34fd tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:32.621424 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-66eb13c8-43b5-41e4-ab16-2b71610b34fd tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1258 microversion: 2.1 time: 0.076625 Jul 18 16:55:32.622034 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 267/526] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:32 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:32.685841 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-171a12da-421e-4825-9913-f70088e82c6a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:32.687196 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-171a12da-421e-4825-9913-f70088e82c6a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:32.694111 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-171a12da-421e-4825-9913-f70088e82c6a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:32.698491 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-171a12da-421e-4825-9913-f70088e82c6a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:32.698491 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-171a12da-421e-4825-9913-f70088e82c6a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:32.698491 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-171a12da-421e-4825-9913-f70088e82c6a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:32.838564 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-171a12da-421e-4825-9913-f70088e82c6a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:32.847036 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-171a12da-421e-4825-9913-f70088e82c6a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:32.848684 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-171a12da-421e-4825-9913-f70088e82c6a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:32.849851 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-171a12da-421e-4825-9913-f70088e82c6a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1726 microversion: 2.20 time: 0.167978 Jul 18 16:55:32.850434 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 260/527] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:32 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:32.872091 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7197fe1f-17f9-479b-8846-861049d9a4d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b57f5656-044a-47bb-ae85-a9d2acc4965a"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:32.873237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7197fe1f-17f9-479b-8846-861049d9a4d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:32.880958 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7197fe1f-17f9-479b-8846-861049d9a4d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:32.881434 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7197fe1f-17f9-479b-8846-861049d9a4d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:32.882206 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7197fe1f-17f9-479b-8846-861049d9a4d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:32.882651 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7197fe1f-17f9-479b-8846-861049d9a4d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:32.883231 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-60943070-3dc4-48b4-b2ed-6e9b0a7e1fca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:32.883841 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-60943070-3dc4-48b4-b2ed-6e9b0a7e1fca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:32.891287 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60943070-3dc4-48b4-b2ed-6e9b0a7e1fca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:32.899111 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60943070-3dc4-48b4-b2ed-6e9b0a7e1fca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:32.899111 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60943070-3dc4-48b4-b2ed-6e9b0a7e1fca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:32.899111 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60943070-3dc4-48b4-b2ed-6e9b0a7e1fca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:32.960264 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-60943070-3dc4-48b4-b2ed-6e9b0a7e1fca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:32.968225 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-60943070-3dc4-48b4-b2ed-6e9b0a7e1fca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1237 microversion: 2.1 time: 0.088707 Jul 18 16:55:32.968866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 261/528] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:32 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:33.413864 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:33.638990 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-99e8d003-3def-4b12-b14d-b77bbebad76a tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:33.640349 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-99e8d003-3def-4b12-b14d-b77bbebad76a tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:33.705421 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-99e8d003-3def-4b12-b14d-b77bbebad76a tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:33.713709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-99e8d003-3def-4b12-b14d-b77bbebad76a tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1258 microversion: 2.1 time: 0.078578 Jul 18 16:55:33.714300 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 262/529] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:33 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:33.985951 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-af64397f-9bc8-4f59-8817-61f3e2821d40 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:33.986664 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-af64397f-9bc8-4f59-8817-61f3e2821d40 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:33.993725 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af64397f-9bc8-4f59-8817-61f3e2821d40 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:33.994816 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af64397f-9bc8-4f59-8817-61f3e2821d40 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:33.995602 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af64397f-9bc8-4f59-8817-61f3e2821d40 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:33.996044 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af64397f-9bc8-4f59-8817-61f3e2821d40 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:34.075548 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7197fe1f-17f9-479b-8846-861049d9a4d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "POST /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.207287 Jul 18 16:55:34.084744 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 268/530] 10.222.0.76 () {62 vars in 1363 bytes} [Mon Jul 18 16:55:32 2022] POST /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments => generated 188 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:55:34.091738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-af64397f-9bc8-4f59-8817-61f3e2821d40 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:34.102339 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-af64397f-9bc8-4f59-8817-61f3e2821d40 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1301 microversion: 2.1 time: 0.120524 Jul 18 16:55:34.103411 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 263/531] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:33 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1301 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:34.219858 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-90eb7a8f-963d-4303-b73d-45395cc1837e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:34.222774 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-90eb7a8f-963d-4303-b73d-45395cc1837e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:34.232181 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-90eb7a8f-963d-4303-b73d-45395cc1837e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:34.232639 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-90eb7a8f-963d-4303-b73d-45395cc1837e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:34.233491 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-90eb7a8f-963d-4303-b73d-45395cc1837e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:34.234141 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-90eb7a8f-963d-4303-b73d-45395cc1837e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:34.518114 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-90eb7a8f-963d-4303-b73d-45395cc1837e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "POST /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/action" status: 202 len: 0 microversion: 2.20 time: 0.306564 Jul 18 16:55:34.518736 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 269/532] 10.222.0.76 () {62 vars in 1318 bytes} [Mon Jul 18 16:55:34 2022] POST /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:55:34.528791 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3c2a30c0-fceb-4405-83ff-872b4e628dd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:34.529472 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3c2a30c0-fceb-4405-83ff-872b4e628dd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:34.532981 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:34.546043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3c2a30c0-fceb-4405-83ff-872b4e628dd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:34.546832 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3c2a30c0-fceb-4405-83ff-872b4e628dd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:34.547888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3c2a30c0-fceb-4405-83ff-872b4e628dd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:34.548522 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3c2a30c0-fceb-4405-83ff-872b4e628dd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:34.566401 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:34.731607 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fa72c5ee-5765-4953-82fc-d7f43195d74d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:34.732217 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fa72c5ee-5765-4953-82fc-d7f43195d74d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:34.739849 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa72c5ee-5765-4953-82fc-d7f43195d74d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:34.740277 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa72c5ee-5765-4953-82fc-d7f43195d74d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:34.741382 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa72c5ee-5765-4953-82fc-d7f43195d74d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:34.741811 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa72c5ee-5765-4953-82fc-d7f43195d74d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:34.777573 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3c2a30c0-fceb-4405-83ff-872b4e628dd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:34.787906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3c2a30c0-fceb-4405-83ff-872b4e628dd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:34.789721 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3c2a30c0-fceb-4405-83ff-872b4e628dd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:34.791211 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3c2a30c0-fceb-4405-83ff-872b4e628dd3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1752 microversion: 2.20 time: 0.268199 Jul 18 16:55:34.801408 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 264/533] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:34 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1752 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:34.827775 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fa72c5ee-5765-4953-82fc-d7f43195d74d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:34.836018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fa72c5ee-5765-4953-82fc-d7f43195d74d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1310 microversion: 2.1 time: 0.108979 Jul 18 16:55:34.836783 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 270/534] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:34 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1310 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:35.120230 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-60290cfd-66a9-41ea-8ba2-7c9a5c558ec8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:35.123091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-60290cfd-66a9-41ea-8ba2-7c9a5c558ec8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:35.130219 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60290cfd-66a9-41ea-8ba2-7c9a5c558ec8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:35.130679 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60290cfd-66a9-41ea-8ba2-7c9a5c558ec8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:35.131456 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60290cfd-66a9-41ea-8ba2-7c9a5c558ec8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:35.131960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60290cfd-66a9-41ea-8ba2-7c9a5c558ec8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:35.370476 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-60290cfd-66a9-41ea-8ba2-7c9a5c558ec8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:35.379109 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-60290cfd-66a9-41ea-8ba2-7c9a5c558ec8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.262633 Jul 18 16:55:35.380120 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 265/535] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:35 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:35.812061 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b39e6f73-c05f-40ff-a863-456205068b5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:35.813395 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b39e6f73-c05f-40ff-a863-456205068b5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:35.824258 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b39e6f73-c05f-40ff-a863-456205068b5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:35.824718 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b39e6f73-c05f-40ff-a863-456205068b5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:35.825703 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b39e6f73-c05f-40ff-a863-456205068b5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:35.826184 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b39e6f73-c05f-40ff-a863-456205068b5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:35.854053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0432badd-2423-49d0-9325-6c50f9df4304 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:35.854669 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0432badd-2423-49d0-9325-6c50f9df4304 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:35.862780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0432badd-2423-49d0-9325-6c50f9df4304 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:35.863505 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0432badd-2423-49d0-9325-6c50f9df4304 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:35.864418 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0432badd-2423-49d0-9325-6c50f9df4304 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:35.864866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0432badd-2423-49d0-9325-6c50f9df4304 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:35.952772 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0432badd-2423-49d0-9325-6c50f9df4304 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:35.960580 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0432badd-2423-49d0-9325-6c50f9df4304 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1328 microversion: 2.1 time: 0.110426 Jul 18 16:55:35.965425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 266/536] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:35 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1328 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:35.988525 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b39e6f73-c05f-40ff-a863-456205068b5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:35.997531 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b39e6f73-c05f-40ff-a863-456205068b5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:35.999763 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b39e6f73-c05f-40ff-a863-456205068b5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:36.001189 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b39e6f73-c05f-40ff-a863-456205068b5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1752 microversion: 2.20 time: 0.193697 Jul 18 16:55:36.001833 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 271/537] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:35 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1752 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:55:36.397543 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-03bace96-2326-470e-99f1-6cc3c7531d5c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:36.398156 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-03bace96-2326-470e-99f1-6cc3c7531d5c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:36.408245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-03bace96-2326-470e-99f1-6cc3c7531d5c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:36.408696 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-03bace96-2326-470e-99f1-6cc3c7531d5c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:36.409511 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-03bace96-2326-470e-99f1-6cc3c7531d5c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:36.409940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-03bace96-2326-470e-99f1-6cc3c7531d5c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:36.655532 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-90e0c0c8-52d6-41ed-96bf-a2767848116e req-2158949a-222e-4503-b492-efedf4bc5d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a961f74-97c0-4862-a288-ff06a9aa55e9", "tag": "ccdc3f7f-7e82-4dab-94cd-51b784a19c64"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:36.671877 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-90e0c0c8-52d6-41ed-96bf-a2767848116e req-2158949a-222e-4503-b492-efedf4bc5d5a service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:36.674973 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-90e0c0c8-52d6-41ed-96bf-a2767848116e req-2158949a-222e-4503-b492-efedf4bc5d5a service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:36.702893 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-90e0c0c8-52d6-41ed-96bf-a2767848116e req-2158949a-222e-4503-b492-efedf4bc5d5a service nova] Creating event network-changed:ccdc3f7f-7e82-4dab-94cd-51b784a19c64 for instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 on hv-cinder-83754 Jul 18 16:55:36.708873 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-90e0c0c8-52d6-41ed-96bf-a2767848116e req-2158949a-222e-4503-b492-efedf4bc5d5a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058633 Jul 18 16:55:36.709661 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 272/538] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:55:36.758894 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-03bace96-2326-470e-99f1-6cc3c7531d5c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:36.781231 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-03bace96-2326-470e-99f1-6cc3c7531d5c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.385026 Jul 18 16:55:36.783660 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 267/539] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:36 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:36.979417 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-17566447-3884-4207-b3a5-49aae255c4e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:36.980787 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-17566447-3884-4207-b3a5-49aae255c4e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:37.004711 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17566447-3884-4207-b3a5-49aae255c4e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:37.005509 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17566447-3884-4207-b3a5-49aae255c4e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:37.007833 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17566447-3884-4207-b3a5-49aae255c4e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:37.008998 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17566447-3884-4207-b3a5-49aae255c4e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:37.021284 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d693a31a-0b5f-4d61-be82-c80e61b2953c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:37.022728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d693a31a-0b5f-4d61-be82-c80e61b2953c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:37.046953 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d693a31a-0b5f-4d61-be82-c80e61b2953c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:37.047403 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d693a31a-0b5f-4d61-be82-c80e61b2953c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:37.048391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d693a31a-0b5f-4d61-be82-c80e61b2953c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:37.049052 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d693a31a-0b5f-4d61-be82-c80e61b2953c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:37.227404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d693a31a-0b5f-4d61-be82-c80e61b2953c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:37.239893 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d693a31a-0b5f-4d61-be82-c80e61b2953c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:37.245042 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d693a31a-0b5f-4d61-be82-c80e61b2953c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:37.247149 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d693a31a-0b5f-4d61-be82-c80e61b2953c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.230090 Jul 18 16:55:37.251443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 268/540] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:37 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:55:37.273717 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-17566447-3884-4207-b3a5-49aae255c4e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:37.285741 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-17566447-3884-4207-b3a5-49aae255c4e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.311109 Jul 18 16:55:37.286421 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 273/541] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:36 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:37.800330 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-853774db-070b-468c-887a-c6aea4929caf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:37.800953 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-853774db-070b-468c-887a-c6aea4929caf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:37.807100 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-853774db-070b-468c-887a-c6aea4929caf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:37.807550 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-853774db-070b-468c-887a-c6aea4929caf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:37.808314 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-853774db-070b-468c-887a-c6aea4929caf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:37.808747 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-853774db-070b-468c-887a-c6aea4929caf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:37.948716 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-853774db-070b-468c-887a-c6aea4929caf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:37.956687 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-853774db-070b-468c-887a-c6aea4929caf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.160252 Jul 18 16:55:37.957293 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 269/542] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:37 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:38.269522 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c6a440a8-3b25-4e17-b246-b432464305d8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:38.270154 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c6a440a8-3b25-4e17-b246-b432464305d8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:38.276776 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c6a440a8-3b25-4e17-b246-b432464305d8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:38.277389 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c6a440a8-3b25-4e17-b246-b432464305d8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:38.278264 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c6a440a8-3b25-4e17-b246-b432464305d8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:38.278705 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c6a440a8-3b25-4e17-b246-b432464305d8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:38.303095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8b84c236-6d22-482f-85df-bd80fbe46bb6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:38.304423 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8b84c236-6d22-482f-85df-bd80fbe46bb6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:38.311658 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b84c236-6d22-482f-85df-bd80fbe46bb6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:38.312277 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b84c236-6d22-482f-85df-bd80fbe46bb6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:38.313223 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b84c236-6d22-482f-85df-bd80fbe46bb6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:38.313754 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b84c236-6d22-482f-85df-bd80fbe46bb6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:38.429262 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c6a440a8-3b25-4e17-b246-b432464305d8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:38.439290 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c6a440a8-3b25-4e17-b246-b432464305d8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:38.441116 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c6a440a8-3b25-4e17-b246-b432464305d8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:38.442384 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c6a440a8-3b25-4e17-b246-b432464305d8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.176794 Jul 18 16:55:38.443168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 274/543] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:38 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:38.454688 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8b84c236-6d22-482f-85df-bd80fbe46bb6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:38.462438 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8b84c236-6d22-482f-85df-bd80fbe46bb6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.163169 Jul 18 16:55:38.463044 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 270/544] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:38 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:38.974556 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f45d134a-0bb5-4d65-b0c4-785518c2620b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:38.975192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f45d134a-0bb5-4d65-b0c4-785518c2620b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:38.981752 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f45d134a-0bb5-4d65-b0c4-785518c2620b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:38.982249 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f45d134a-0bb5-4d65-b0c4-785518c2620b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:38.983583 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f45d134a-0bb5-4d65-b0c4-785518c2620b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:38.985179 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f45d134a-0bb5-4d65-b0c4-785518c2620b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:39.095691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:39.128249 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f45d134a-0bb5-4d65-b0c4-785518c2620b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:39.136374 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f45d134a-0bb5-4d65-b0c4-785518c2620b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.165683 Jul 18 16:55:39.136950 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 275/545] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:38 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:39.462437 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-86e7af13-157b-4872-90bd-820c3a70fee2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:39.463043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-86e7af13-157b-4872-90bd-820c3a70fee2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:39.470426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86e7af13-157b-4872-90bd-820c3a70fee2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:39.470880 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86e7af13-157b-4872-90bd-820c3a70fee2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:39.471642 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86e7af13-157b-4872-90bd-820c3a70fee2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:39.472078 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86e7af13-157b-4872-90bd-820c3a70fee2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:39.479045 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-54b5cee4-4603-4cec-990b-93021ae452f8 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:39.479739 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-54b5cee4-4603-4cec-990b-93021ae452f8 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:39.488149 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54b5cee4-4603-4cec-990b-93021ae452f8 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:39.488654 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54b5cee4-4603-4cec-990b-93021ae452f8 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:39.489535 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54b5cee4-4603-4cec-990b-93021ae452f8 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:39.490044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54b5cee4-4603-4cec-990b-93021ae452f8 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:39.620889 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-86e7af13-157b-4872-90bd-820c3a70fee2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:39.630634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-86e7af13-157b-4872-90bd-820c3a70fee2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:39.632974 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-86e7af13-157b-4872-90bd-820c3a70fee2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:39.635157 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-86e7af13-157b-4872-90bd-820c3a70fee2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.176693 Jul 18 16:55:39.635513 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-54b5cee4-4603-4cec-990b-93021ae452f8 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:39.636678 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 271/546] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:39 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:39.644976 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-54b5cee4-4603-4cec-990b-93021ae452f8 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.169620 Jul 18 16:55:39.649044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 276/547] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:39 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:40.153849 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bb53e3f5-25af-402a-b90e-ddc2a13545ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:40.156604 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bb53e3f5-25af-402a-b90e-ddc2a13545ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:40.163162 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb53e3f5-25af-402a-b90e-ddc2a13545ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:40.163603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb53e3f5-25af-402a-b90e-ddc2a13545ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:40.164381 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb53e3f5-25af-402a-b90e-ddc2a13545ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:40.164815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb53e3f5-25af-402a-b90e-ddc2a13545ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:40.309773 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bb53e3f5-25af-402a-b90e-ddc2a13545ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:40.318337 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bb53e3f5-25af-402a-b90e-ddc2a13545ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.169005 Jul 18 16:55:40.319323 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 272/548] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:40 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:40.663700 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9b454e00-6c52-42e0-a674-303a18403fbb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:40.664491 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9b454e00-6c52-42e0-a674-303a18403fbb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:40.668894 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9401c31d-814e-43bb-ab88-725e03e67755 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:40.669627 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9401c31d-814e-43bb-ab88-725e03e67755 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:40.672031 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9b454e00-6c52-42e0-a674-303a18403fbb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:40.672525 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9b454e00-6c52-42e0-a674-303a18403fbb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:40.673347 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9b454e00-6c52-42e0-a674-303a18403fbb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:40.673798 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9b454e00-6c52-42e0-a674-303a18403fbb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:40.680249 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9401c31d-814e-43bb-ab88-725e03e67755 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:40.680761 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9401c31d-814e-43bb-ab88-725e03e67755 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:40.681564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9401c31d-814e-43bb-ab88-725e03e67755 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:40.682008 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9401c31d-814e-43bb-ab88-725e03e67755 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:40.831223 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9401c31d-814e-43bb-ab88-725e03e67755 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:40.835297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9b454e00-6c52-42e0-a674-303a18403fbb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:40.840352 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9401c31d-814e-43bb-ab88-725e03e67755 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:40.842818 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9401c31d-814e-43bb-ab88-725e03e67755 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:40.844501 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9401c31d-814e-43bb-ab88-725e03e67755 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.193259 Jul 18 16:55:40.845038 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9b454e00-6c52-42e0-a674-303a18403fbb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.185334 Jul 18 16:55:40.845349 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 277/549] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:40 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:40.851190 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 273/550] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:40 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:41.335667 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3409a96d-fe25-4c7c-b6c3-0a2305e4ff9d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:41.336287 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3409a96d-fe25-4c7c-b6c3-0a2305e4ff9d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:41.342766 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3409a96d-fe25-4c7c-b6c3-0a2305e4ff9d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:41.343229 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3409a96d-fe25-4c7c-b6c3-0a2305e4ff9d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:41.344012 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3409a96d-fe25-4c7c-b6c3-0a2305e4ff9d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:41.344451 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3409a96d-fe25-4c7c-b6c3-0a2305e4ff9d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:41.485125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3409a96d-fe25-4c7c-b6c3-0a2305e4ff9d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:41.493157 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3409a96d-fe25-4c7c-b6c3-0a2305e4ff9d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.161295 Jul 18 16:55:41.493755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 278/551] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:41 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:41.863483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dfab430c-5d66-47cb-ad87-a2ad010e7e18 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:41.864974 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dfab430c-5d66-47cb-ad87-a2ad010e7e18 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:41.869272 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-da19b21f-837c-4dc4-a75a-712028de3cc8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:41.869855 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-da19b21f-837c-4dc4-a75a-712028de3cc8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:41.871962 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dfab430c-5d66-47cb-ad87-a2ad010e7e18 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:41.872587 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dfab430c-5d66-47cb-ad87-a2ad010e7e18 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:41.873230 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dfab430c-5d66-47cb-ad87-a2ad010e7e18 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:41.873910 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dfab430c-5d66-47cb-ad87-a2ad010e7e18 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:41.876242 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-da19b21f-837c-4dc4-a75a-712028de3cc8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:41.876702 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-da19b21f-837c-4dc4-a75a-712028de3cc8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:41.877503 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-da19b21f-837c-4dc4-a75a-712028de3cc8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:41.877948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-da19b21f-837c-4dc4-a75a-712028de3cc8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:42.021422 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-da19b21f-837c-4dc4-a75a-712028de3cc8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:42.030609 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-da19b21f-837c-4dc4-a75a-712028de3cc8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:42.032161 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-da19b21f-837c-4dc4-a75a-712028de3cc8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:42.033369 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-da19b21f-837c-4dc4-a75a-712028de3cc8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.168154 Jul 18 16:55:42.033931 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 279/552] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:41 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:42.035826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dfab430c-5d66-47cb-ad87-a2ad010e7e18 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:42.043584 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dfab430c-5d66-47cb-ad87-a2ad010e7e18 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.184235 Jul 18 16:55:42.044152 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 274/553] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:41 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:42.510306 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f16cc329-4036-4d22-adf4-7bfe252030a8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:42.510899 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f16cc329-4036-4d22-adf4-7bfe252030a8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:42.517923 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f16cc329-4036-4d22-adf4-7bfe252030a8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:42.518371 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f16cc329-4036-4d22-adf4-7bfe252030a8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:42.519148 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f16cc329-4036-4d22-adf4-7bfe252030a8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:42.519587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f16cc329-4036-4d22-adf4-7bfe252030a8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:42.618826 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=12 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:42.888313 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f16cc329-4036-4d22-adf4-7bfe252030a8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:42.896229 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f16cc329-4036-4d22-adf4-7bfe252030a8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.389906 Jul 18 16:55:42.896806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 280/554] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:42 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:43.052721 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dd7e2322-39b7-4848-954b-e3496ef5aa6d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:43.053499 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dd7e2322-39b7-4848-954b-e3496ef5aa6d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:43.057552 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:43.063999 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-52fba02b-564b-4ac5-b5f0-6b7e0a22ec45 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:43.064625 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-52fba02b-564b-4ac5-b5f0-6b7e0a22ec45 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:43.065241 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dd7e2322-39b7-4848-954b-e3496ef5aa6d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:43.070737 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dd7e2322-39b7-4848-954b-e3496ef5aa6d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:43.070737 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dd7e2322-39b7-4848-954b-e3496ef5aa6d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:43.070737 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dd7e2322-39b7-4848-954b-e3496ef5aa6d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:43.071215 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52fba02b-564b-4ac5-b5f0-6b7e0a22ec45 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:43.071677 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52fba02b-564b-4ac5-b5f0-6b7e0a22ec45 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:43.072690 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52fba02b-564b-4ac5-b5f0-6b7e0a22ec45 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:43.072911 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52fba02b-564b-4ac5-b5f0-6b7e0a22ec45 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:43.221349 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-52fba02b-564b-4ac5-b5f0-6b7e0a22ec45 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:43.221629 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dd7e2322-39b7-4848-954b-e3496ef5aa6d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:43.228849 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-52fba02b-564b-4ac5-b5f0-6b7e0a22ec45 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.172550 Jul 18 16:55:43.229439 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 281/555] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:43 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:43.230067 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dd7e2322-39b7-4848-954b-e3496ef5aa6d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:43.231715 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dd7e2322-39b7-4848-954b-e3496ef5aa6d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:43.233638 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dd7e2322-39b7-4848-954b-e3496ef5aa6d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.184233 Jul 18 16:55:43.234183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 275/556] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:43 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:43.913798 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e6d7b00b-7a5e-4dc5-9678-f6110f99eb81 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:43.914408 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e6d7b00b-7a5e-4dc5-9678-f6110f99eb81 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:43.921372 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e6d7b00b-7a5e-4dc5-9678-f6110f99eb81 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:43.921829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e6d7b00b-7a5e-4dc5-9678-f6110f99eb81 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:43.922597 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e6d7b00b-7a5e-4dc5-9678-f6110f99eb81 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:43.923076 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e6d7b00b-7a5e-4dc5-9678-f6110f99eb81 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:44.090607 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e6d7b00b-7a5e-4dc5-9678-f6110f99eb81 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:44.100062 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e6d7b00b-7a5e-4dc5-9678-f6110f99eb81 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.190019 Jul 18 16:55:44.100661 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 282/557] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:43 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:44.246510 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4bbb6341-394b-4877-bce7-48f7f13a0b81 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:44.247128 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4bbb6341-394b-4877-bce7-48f7f13a0b81 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:44.249043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=16 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:44.256351 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-30fcb865-ed70-4814-bf6d-3c29382773d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:44.258245 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-30fcb865-ed70-4814-bf6d-3c29382773d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:44.260981 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4bbb6341-394b-4877-bce7-48f7f13a0b81 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:44.261480 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4bbb6341-394b-4877-bce7-48f7f13a0b81 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:44.262266 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4bbb6341-394b-4877-bce7-48f7f13a0b81 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:44.262705 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4bbb6341-394b-4877-bce7-48f7f13a0b81 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:44.264470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-30fcb865-ed70-4814-bf6d-3c29382773d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:44.264950 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-30fcb865-ed70-4814-bf6d-3c29382773d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:44.265819 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-30fcb865-ed70-4814-bf6d-3c29382773d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:44.266300 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-30fcb865-ed70-4814-bf6d-3c29382773d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:44.283104 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:44.406126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4bbb6341-394b-4877-bce7-48f7f13a0b81 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:44.413484 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-30fcb865-ed70-4814-bf6d-3c29382773d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:44.413905 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4bbb6341-394b-4877-bce7-48f7f13a0b81 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.172054 Jul 18 16:55:44.414806 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 276/558] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:44 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:44.423135 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-30fcb865-ed70-4814-bf6d-3c29382773d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:44.424660 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-30fcb865-ed70-4814-bf6d-3c29382773d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:44.425941 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-30fcb865-ed70-4814-bf6d-3c29382773d4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.173663 Jul 18 16:55:44.426489 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 283/559] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:44 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:45.119948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d03c93af-c10f-408b-a690-39e59bc80a83 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:45.120485 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d03c93af-c10f-408b-a690-39e59bc80a83 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:45.127364 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d03c93af-c10f-408b-a690-39e59bc80a83 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.127812 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d03c93af-c10f-408b-a690-39e59bc80a83 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.128575 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d03c93af-c10f-408b-a690-39e59bc80a83 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.129027 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d03c93af-c10f-408b-a690-39e59bc80a83 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.271914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d03c93af-c10f-408b-a690-39e59bc80a83 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:45.280562 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d03c93af-c10f-408b-a690-39e59bc80a83 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.164515 Jul 18 16:55:45.289896 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 277/560] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:45 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:45.432472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-87df2bc6-ec70-4a35-828f-4581f0781c2f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:45.433052 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-87df2bc6-ec70-4a35-828f-4581f0781c2f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:45.439907 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-87df2bc6-ec70-4a35-828f-4581f0781c2f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.440450 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-87df2bc6-ec70-4a35-828f-4581f0781c2f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.441391 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-87df2bc6-ec70-4a35-828f-4581f0781c2f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.441796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-87df2bc6-ec70-4a35-828f-4581f0781c2f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.445151 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-27c10ed6-2500-42e2-bb30-d715bd6eb49a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:45.445773 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-27c10ed6-2500-42e2-bb30-d715bd6eb49a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:45.452095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27c10ed6-2500-42e2-bb30-d715bd6eb49a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.452960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27c10ed6-2500-42e2-bb30-d715bd6eb49a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.453867 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27c10ed6-2500-42e2-bb30-d715bd6eb49a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.454374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27c10ed6-2500-42e2-bb30-d715bd6eb49a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.591766 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-87df2bc6-ec70-4a35-828f-4581f0781c2f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:45.600956 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-87df2bc6-ec70-4a35-828f-4581f0781c2f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.172896 Jul 18 16:55:45.601973 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 284/561] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:45 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:45.620183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-27c10ed6-2500-42e2-bb30-d715bd6eb49a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:45.629899 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-27c10ed6-2500-42e2-bb30-d715bd6eb49a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:45.631424 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-27c10ed6-2500-42e2-bb30-d715bd6eb49a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:45.632609 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-27c10ed6-2500-42e2-bb30-d715bd6eb49a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.191627 Jul 18 16:55:45.633267 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 278/562] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:45 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:55:46.298603 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f5449c64-d32c-4e7f-8331-5529cb7c28a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:46.299133 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f5449c64-d32c-4e7f-8331-5529cb7c28a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:46.308810 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f5449c64-d32c-4e7f-8331-5529cb7c28a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:46.311764 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f5449c64-d32c-4e7f-8331-5529cb7c28a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:46.311764 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f5449c64-d32c-4e7f-8331-5529cb7c28a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:46.311764 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f5449c64-d32c-4e7f-8331-5529cb7c28a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:46.464944 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f5449c64-d32c-4e7f-8331-5529cb7c28a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:46.472937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f5449c64-d32c-4e7f-8331-5529cb7c28a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.179335 Jul 18 16:55:46.473554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 285/563] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:46 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:46.660675 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7b131795-3422-47cf-a554-bd3d4e013d14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:46.660675 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7b131795-3422-47cf-a554-bd3d4e013d14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:46.660675 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7b131795-3422-47cf-a554-bd3d4e013d14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:46.660675 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7b131795-3422-47cf-a554-bd3d4e013d14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:46.661823 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7b131795-3422-47cf-a554-bd3d4e013d14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:46.661823 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7b131795-3422-47cf-a554-bd3d4e013d14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:46.662012 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-74ed3c08-5cd9-4081-bf9c-398fa5435de0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:46.662012 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-74ed3c08-5cd9-4081-bf9c-398fa5435de0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:46.662012 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-74ed3c08-5cd9-4081-bf9c-398fa5435de0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:46.662012 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-74ed3c08-5cd9-4081-bf9c-398fa5435de0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:46.662473 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-74ed3c08-5cd9-4081-bf9c-398fa5435de0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:46.662473 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-74ed3c08-5cd9-4081-bf9c-398fa5435de0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:46.800511 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7b131795-3422-47cf-a554-bd3d4e013d14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:46.853527 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7b131795-3422-47cf-a554-bd3d4e013d14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.199763 Jul 18 16:55:46.853527 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 279/564] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:46 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:46.853899 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-74ed3c08-5cd9-4081-bf9c-398fa5435de0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:46.853899 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-74ed3c08-5cd9-4081-bf9c-398fa5435de0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:46.854136 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-74ed3c08-5cd9-4081-bf9c-398fa5435de0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:46.854136 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-74ed3c08-5cd9-4081-bf9c-398fa5435de0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.192113 Jul 18 16:55:46.854136 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 286/565] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:46 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:55:47.490879 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-43665746-e8c6-4615-b16d-27e47843c55a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:47.491409 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-43665746-e8c6-4615-b16d-27e47843c55a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:47.497606 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43665746-e8c6-4615-b16d-27e47843c55a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:47.498064 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43665746-e8c6-4615-b16d-27e47843c55a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:47.499219 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43665746-e8c6-4615-b16d-27e47843c55a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:47.500229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43665746-e8c6-4615-b16d-27e47843c55a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:47.758744 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-43665746-e8c6-4615-b16d-27e47843c55a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:47.758744 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-43665746-e8c6-4615-b16d-27e47843c55a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.169296 Jul 18 16:55:47.758744 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 280/566] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:47 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:47.833046 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bd900379-5221-4b37-8eec-d9d426673c61 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:47.833678 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bd900379-5221-4b37-8eec-d9d426673c61 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:47.839802 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bd900379-5221-4b37-8eec-d9d426673c61 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:47.840254 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bd900379-5221-4b37-8eec-d9d426673c61 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:47.841100 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bd900379-5221-4b37-8eec-d9d426673c61 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:47.841488 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bd900379-5221-4b37-8eec-d9d426673c61 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:47.864727 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e075c8c4-7329-4f74-9178-e7ad958059bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:47.865367 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e075c8c4-7329-4f74-9178-e7ad958059bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:47.871806 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e075c8c4-7329-4f74-9178-e7ad958059bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:47.872254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e075c8c4-7329-4f74-9178-e7ad958059bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:47.873048 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e075c8c4-7329-4f74-9178-e7ad958059bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:47.873661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e075c8c4-7329-4f74-9178-e7ad958059bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:47.878295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:48.010380 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-bd900379-5221-4b37-8eec-d9d426673c61 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:48.018496 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bd900379-5221-4b37-8eec-d9d426673c61 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.189423 Jul 18 16:55:48.027661 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 287/567] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:47 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:48.048586 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e075c8c4-7329-4f74-9178-e7ad958059bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:48.057833 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e075c8c4-7329-4f74-9178-e7ad958059bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:48.059442 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e075c8c4-7329-4f74-9178-e7ad958059bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:48.061213 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e075c8c4-7329-4f74-9178-e7ad958059bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.199944 Jul 18 16:55:48.061932 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 281/568] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:47 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:55:48.760651 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d93288a2-1f1f-44a3-9699-e4849778b483 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:48.761282 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d93288a2-1f1f-44a3-9699-e4849778b483 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:48.763231 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:48.769997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d93288a2-1f1f-44a3-9699-e4849778b483 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:48.770473 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d93288a2-1f1f-44a3-9699-e4849778b483 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:48.771318 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d93288a2-1f1f-44a3-9699-e4849778b483 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:48.771780 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d93288a2-1f1f-44a3-9699-e4849778b483 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:48.919101 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d93288a2-1f1f-44a3-9699-e4849778b483 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:48.927560 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d93288a2-1f1f-44a3-9699-e4849778b483 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.171045 Jul 18 16:55:48.928143 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 288/569] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:48 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:49.035773 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6c77244b-e8d7-4f8d-bac1-c9bf766aa54e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:49.036349 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6c77244b-e8d7-4f8d-bac1-c9bf766aa54e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:49.043903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6c77244b-e8d7-4f8d-bac1-c9bf766aa54e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:49.044358 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6c77244b-e8d7-4f8d-bac1-c9bf766aa54e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:49.045166 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6c77244b-e8d7-4f8d-bac1-c9bf766aa54e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:49.046164 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6c77244b-e8d7-4f8d-bac1-c9bf766aa54e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:49.079802 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aa92915d-d525-46d3-80a7-e978a7f6cf55 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:49.080580 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aa92915d-d525-46d3-80a7-e978a7f6cf55 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:49.088937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa92915d-d525-46d3-80a7-e978a7f6cf55 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:49.088937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa92915d-d525-46d3-80a7-e978a7f6cf55 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:49.089724 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa92915d-d525-46d3-80a7-e978a7f6cf55 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:49.090167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa92915d-d525-46d3-80a7-e978a7f6cf55 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:49.196664 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6c77244b-e8d7-4f8d-bac1-c9bf766aa54e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:49.206402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6c77244b-e8d7-4f8d-bac1-c9bf766aa54e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.174597 Jul 18 16:55:49.209057 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 282/570] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:49 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:49.246825 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aa92915d-d525-46d3-80a7-e978a7f6cf55 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:49.256689 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aa92915d-d525-46d3-80a7-e978a7f6cf55 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:49.258252 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aa92915d-d525-46d3-80a7-e978a7f6cf55 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:49.259421 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aa92915d-d525-46d3-80a7-e978a7f6cf55 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.183621 Jul 18 16:55:49.259986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 289/571] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:49 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:55:49.945764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1eba7b52-be9d-4713-aebc-bde57bc3b9dc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:49.946339 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1eba7b52-be9d-4713-aebc-bde57bc3b9dc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:49.953216 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1eba7b52-be9d-4713-aebc-bde57bc3b9dc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:49.953671 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1eba7b52-be9d-4713-aebc-bde57bc3b9dc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:49.954450 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1eba7b52-be9d-4713-aebc-bde57bc3b9dc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:49.954891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1eba7b52-be9d-4713-aebc-bde57bc3b9dc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:50.091620 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1eba7b52-be9d-4713-aebc-bde57bc3b9dc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:50.099231 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1eba7b52-be9d-4713-aebc-bde57bc3b9dc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.157565 Jul 18 16:55:50.099790 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 283/572] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:49 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:50.222963 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9a58ece3-a3f3-457b-8d1e-c8078894cf2a tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:50.223674 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9a58ece3-a3f3-457b-8d1e-c8078894cf2a tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:50.230069 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a58ece3-a3f3-457b-8d1e-c8078894cf2a tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:50.230524 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a58ece3-a3f3-457b-8d1e-c8078894cf2a tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:50.231389 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a58ece3-a3f3-457b-8d1e-c8078894cf2a tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:50.231835 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a58ece3-a3f3-457b-8d1e-c8078894cf2a tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:50.278531 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d80b0c0b-16fb-4f1e-9a08-7728a672b127 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:50.279179 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d80b0c0b-16fb-4f1e-9a08-7728a672b127 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:50.285505 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d80b0c0b-16fb-4f1e-9a08-7728a672b127 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:50.285951 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d80b0c0b-16fb-4f1e-9a08-7728a672b127 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:50.286706 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d80b0c0b-16fb-4f1e-9a08-7728a672b127 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:50.287140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d80b0c0b-16fb-4f1e-9a08-7728a672b127 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:50.363794 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9a58ece3-a3f3-457b-8d1e-c8078894cf2a tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:50.371454 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9a58ece3-a3f3-457b-8d1e-c8078894cf2a tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.152388 Jul 18 16:55:50.372024 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 290/573] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:50 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:50.418458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d80b0c0b-16fb-4f1e-9a08-7728a672b127 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:50.427600 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d80b0c0b-16fb-4f1e-9a08-7728a672b127 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:50.429181 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d80b0c0b-16fb-4f1e-9a08-7728a672b127 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:50.430342 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d80b0c0b-16fb-4f1e-9a08-7728a672b127 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.155927 Jul 18 16:55:50.430895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 284/574] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:50 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:51.116139 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5f194494-ea21-4196-bbf6-96000dd59051 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:51.116742 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5f194494-ea21-4196-bbf6-96000dd59051 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:51.122900 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f194494-ea21-4196-bbf6-96000dd59051 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:51.123350 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f194494-ea21-4196-bbf6-96000dd59051 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:51.124595 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f194494-ea21-4196-bbf6-96000dd59051 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:51.124595 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f194494-ea21-4196-bbf6-96000dd59051 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:51.257334 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5f194494-ea21-4196-bbf6-96000dd59051 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:51.265282 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5f194494-ea21-4196-bbf6-96000dd59051 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.152962 Jul 18 16:55:51.265849 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 291/575] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:51 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:51.388306 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b51fa1c5-5fae-40f2-b371-5a01280ed081 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:51.388853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b51fa1c5-5fae-40f2-b371-5a01280ed081 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:51.396266 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b51fa1c5-5fae-40f2-b371-5a01280ed081 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:51.396719 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b51fa1c5-5fae-40f2-b371-5a01280ed081 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:51.397561 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b51fa1c5-5fae-40f2-b371-5a01280ed081 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:51.398003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b51fa1c5-5fae-40f2-b371-5a01280ed081 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:51.449135 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-223f4682-a117-4c04-b4b6-3ac4c9d47e79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:51.449742 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-223f4682-a117-4c04-b4b6-3ac4c9d47e79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:51.456486 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-223f4682-a117-4c04-b4b6-3ac4c9d47e79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:51.457048 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-223f4682-a117-4c04-b4b6-3ac4c9d47e79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:51.457779 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-223f4682-a117-4c04-b4b6-3ac4c9d47e79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:51.458225 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-223f4682-a117-4c04-b4b6-3ac4c9d47e79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:51.531455 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b51fa1c5-5fae-40f2-b371-5a01280ed081 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:51.539000 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b51fa1c5-5fae-40f2-b371-5a01280ed081 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.154507 Jul 18 16:55:51.539646 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 285/576] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:51 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:51.592647 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-223f4682-a117-4c04-b4b6-3ac4c9d47e79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:51.601505 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-223f4682-a117-4c04-b4b6-3ac4c9d47e79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:51.603006 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-223f4682-a117-4c04-b4b6-3ac4c9d47e79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:51.604159 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-223f4682-a117-4c04-b4b6-3ac4c9d47e79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.159024 Jul 18 16:55:51.604764 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 292/577] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:51 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:55:52.282863 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a865c31b-ef85-4c68-b448-011177002523 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:52.283470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a865c31b-ef85-4c68-b448-011177002523 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:52.289702 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a865c31b-ef85-4c68-b448-011177002523 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:52.290158 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a865c31b-ef85-4c68-b448-011177002523 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:52.290934 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a865c31b-ef85-4c68-b448-011177002523 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:52.291373 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a865c31b-ef85-4c68-b448-011177002523 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:52.427032 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a865c31b-ef85-4c68-b448-011177002523 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:52.434660 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a865c31b-ef85-4c68-b448-011177002523 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.156270 Jul 18 16:55:52.435234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 286/578] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:52 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:52.556208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0445d9c2-1e56-4e60-986b-711251a5790b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:52.556838 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0445d9c2-1e56-4e60-986b-711251a5790b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:52.563722 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0445d9c2-1e56-4e60-986b-711251a5790b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:52.564176 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0445d9c2-1e56-4e60-986b-711251a5790b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:52.564951 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0445d9c2-1e56-4e60-986b-711251a5790b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:52.565428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0445d9c2-1e56-4e60-986b-711251a5790b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:52.623167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-13b0f4f2-bee1-4a57-8786-1877d0a98a3e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:52.623956 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-13b0f4f2-bee1-4a57-8786-1877d0a98a3e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:52.630227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13b0f4f2-bee1-4a57-8786-1877d0a98a3e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:52.630601 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13b0f4f2-bee1-4a57-8786-1877d0a98a3e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:52.631393 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13b0f4f2-bee1-4a57-8786-1877d0a98a3e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:52.631829 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13b0f4f2-bee1-4a57-8786-1877d0a98a3e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:52.739226 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0445d9c2-1e56-4e60-986b-711251a5790b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:52.747024 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0445d9c2-1e56-4e60-986b-711251a5790b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.194755 Jul 18 16:55:52.747596 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 293/579] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:52 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:52.763850 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-13b0f4f2-bee1-4a57-8786-1877d0a98a3e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:52.773527 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-13b0f4f2-bee1-4a57-8786-1877d0a98a3e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:52.775084 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-13b0f4f2-bee1-4a57-8786-1877d0a98a3e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:52.776275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-13b0f4f2-bee1-4a57-8786-1877d0a98a3e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.157140 Jul 18 16:55:52.776845 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 287/580] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:52 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:55:53.456230 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6ee58019-0eb3-42c7-b2f2-d12bd5068d9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:53.456779 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6ee58019-0eb3-42c7-b2f2-d12bd5068d9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:53.463487 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ee58019-0eb3-42c7-b2f2-d12bd5068d9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:53.463949 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ee58019-0eb3-42c7-b2f2-d12bd5068d9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:53.464741 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ee58019-0eb3-42c7-b2f2-d12bd5068d9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:53.465520 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ee58019-0eb3-42c7-b2f2-d12bd5068d9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:53.631877 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6ee58019-0eb3-42c7-b2f2-d12bd5068d9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:53.641649 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6ee58019-0eb3-42c7-b2f2-d12bd5068d9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.190110 Jul 18 16:55:53.642527 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 294/581] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:53 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:53.765576 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9ffdb270-c13c-4707-8af8-82949de072b3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:53.766203 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9ffdb270-c13c-4707-8af8-82949de072b3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:53.773387 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ffdb270-c13c-4707-8af8-82949de072b3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:53.773841 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ffdb270-c13c-4707-8af8-82949de072b3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:53.774626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ffdb270-c13c-4707-8af8-82949de072b3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:53.775072 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ffdb270-c13c-4707-8af8-82949de072b3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:53.795661 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-be351c2c-c113-40b6-82f5-7a5b1728ac5e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:53.796429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-be351c2c-c113-40b6-82f5-7a5b1728ac5e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:53.803351 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be351c2c-c113-40b6-82f5-7a5b1728ac5e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:53.803806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be351c2c-c113-40b6-82f5-7a5b1728ac5e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:53.804583 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be351c2c-c113-40b6-82f5-7a5b1728ac5e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:53.805041 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be351c2c-c113-40b6-82f5-7a5b1728ac5e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:53.942034 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-be351c2c-c113-40b6-82f5-7a5b1728ac5e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:53.956651 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-be351c2c-c113-40b6-82f5-7a5b1728ac5e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:53.956651 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-be351c2c-c113-40b6-82f5-7a5b1728ac5e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:53.956651 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-be351c2c-c113-40b6-82f5-7a5b1728ac5e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.163064 Jul 18 16:55:53.956959 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 295/582] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:53 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:55:54.102889 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9ffdb270-c13c-4707-8af8-82949de072b3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:54.111082 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9ffdb270-c13c-4707-8af8-82949de072b3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.350563 Jul 18 16:55:54.111657 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 288/583] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:53 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:54.661495 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-00be4f10-dc13-4ffd-8fe8-2e90824e0aba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:54.662356 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-00be4f10-dc13-4ffd-8fe8-2e90824e0aba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:54.669340 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00be4f10-dc13-4ffd-8fe8-2e90824e0aba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:54.669798 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00be4f10-dc13-4ffd-8fe8-2e90824e0aba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:54.670624 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00be4f10-dc13-4ffd-8fe8-2e90824e0aba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:54.671079 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00be4f10-dc13-4ffd-8fe8-2e90824e0aba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:54.729353 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-983e4a62-1f52-433f-8654-59218da939da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:54.729859 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-983e4a62-1f52-433f-8654-59218da939da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:54.737732 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-983e4a62-1f52-433f-8654-59218da939da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:54.738179 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-983e4a62-1f52-433f-8654-59218da939da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:54.739217 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-983e4a62-1f52-433f-8654-59218da939da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:54.739680 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-983e4a62-1f52-433f-8654-59218da939da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:54.768496 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-983e4a62-1f52-433f-8654-59218da939da tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/ips" status: 200 len: 145 microversion: 2.1 time: 0.043723 Jul 18 16:55:54.769861 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 289/584] 10.222.0.76 () {58 vars in 1247 bytes} [Mon Jul 18 16:55:54 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:54.842191 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-00be4f10-dc13-4ffd-8fe8-2e90824e0aba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:54.846075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-00be4f10-dc13-4ffd-8fe8-2e90824e0aba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.190234 Jul 18 16:55:54.846656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 296/585] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:54 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:54.973662 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-899ecb35-3ad8-4390-9dde-9c92b3837f70 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:54.974286 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-899ecb35-3ad8-4390-9dde-9c92b3837f70 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:54.980877 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-899ecb35-3ad8-4390-9dde-9c92b3837f70 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:54.981503 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-899ecb35-3ad8-4390-9dde-9c92b3837f70 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:54.982302 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-899ecb35-3ad8-4390-9dde-9c92b3837f70 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:54.982882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-899ecb35-3ad8-4390-9dde-9c92b3837f70 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:55.021937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-bd4599b9-3843-49c4-9175-c06ae0cb6e50 req-383e4d10-325e-4f2d-83a7-7ff8cefceed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb84650-2a5a-491b-a7fd-2b80fc1b8c57", "tag": "ffbf241e-13b6-4507-9161-8a88eafc095a"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:55.030137 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-bd4599b9-3843-49c4-9175-c06ae0cb6e50 req-383e4d10-325e-4f2d-83a7-7ff8cefceed7 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:55.031486 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-bd4599b9-3843-49c4-9175-c06ae0cb6e50 req-383e4d10-325e-4f2d-83a7-7ff8cefceed7 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:55.045083 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-bd4599b9-3843-49c4-9175-c06ae0cb6e50 req-383e4d10-325e-4f2d-83a7-7ff8cefceed7 service nova] Creating event network-changed:ffbf241e-13b6-4507-9161-8a88eafc095a for instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 on hv-cinder-83754 Jul 18 16:55:55.051321 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-bd4599b9-3843-49c4-9175-c06ae0cb6e50 req-383e4d10-325e-4f2d-83a7-7ff8cefceed7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034233 Jul 18 16:55:55.051911 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 297/586] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:55.130095 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dcb4a791-bc73-45bf-8b01-0643e5bc2757 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:55.130808 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dcb4a791-bc73-45bf-8b01-0643e5bc2757 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:55.137874 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dcb4a791-bc73-45bf-8b01-0643e5bc2757 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:55.138358 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dcb4a791-bc73-45bf-8b01-0643e5bc2757 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:55.139143 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dcb4a791-bc73-45bf-8b01-0643e5bc2757 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:55.139641 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dcb4a791-bc73-45bf-8b01-0643e5bc2757 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:55.152175 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-899ecb35-3ad8-4390-9dde-9c92b3837f70 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:55.163713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-899ecb35-3ad8-4390-9dde-9c92b3837f70 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:55.165312 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-899ecb35-3ad8-4390-9dde-9c92b3837f70 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:55.166883 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-899ecb35-3ad8-4390-9dde-9c92b3837f70 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1754 microversion: 2.20 time: 0.197171 Jul 18 16:55:55.178229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 290/587] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:54 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1754 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:55.291421 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dcb4a791-bc73-45bf-8b01-0643e5bc2757 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:55.299119 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dcb4a791-bc73-45bf-8b01-0643e5bc2757 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.175092 Jul 18 16:55:55.299693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 298/588] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:55 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:55.863865 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-598af4fb-a0cf-46fd-bdaa-d9789c17a988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:55.864589 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-598af4fb-a0cf-46fd-bdaa-d9789c17a988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:55.870849 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-598af4fb-a0cf-46fd-bdaa-d9789c17a988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:55.871330 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-598af4fb-a0cf-46fd-bdaa-d9789c17a988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:55.872114 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-598af4fb-a0cf-46fd-bdaa-d9789c17a988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:55.872555 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-598af4fb-a0cf-46fd-bdaa-d9789c17a988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:56.015563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-598af4fb-a0cf-46fd-bdaa-d9789c17a988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:56.023193 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-598af4fb-a0cf-46fd-bdaa-d9789c17a988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.163592 Jul 18 16:55:56.027992 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 291/589] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:55 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:56.186737 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0bec99d6-8d0f-41b2-8e4f-13d5881dd0cc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:56.188086 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0bec99d6-8d0f-41b2-8e4f-13d5881dd0cc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:56.195092 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0bec99d6-8d0f-41b2-8e4f-13d5881dd0cc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:56.195547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0bec99d6-8d0f-41b2-8e4f-13d5881dd0cc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:56.196327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0bec99d6-8d0f-41b2-8e4f-13d5881dd0cc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:56.196867 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0bec99d6-8d0f-41b2-8e4f-13d5881dd0cc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:56.315831 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0b6ebf09-5a80-480b-8258-3e2fd153b38e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:56.316946 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0b6ebf09-5a80-480b-8258-3e2fd153b38e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:56.323551 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b6ebf09-5a80-480b-8258-3e2fd153b38e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:56.324090 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b6ebf09-5a80-480b-8258-3e2fd153b38e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:56.325273 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b6ebf09-5a80-480b-8258-3e2fd153b38e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:56.325946 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b6ebf09-5a80-480b-8258-3e2fd153b38e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:56.339444 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0bec99d6-8d0f-41b2-8e4f-13d5881dd0cc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:56.348954 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0bec99d6-8d0f-41b2-8e4f-13d5881dd0cc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:56.350532 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0bec99d6-8d0f-41b2-8e4f-13d5881dd0cc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:56.351933 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0bec99d6-8d0f-41b2-8e4f-13d5881dd0cc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.169249 Jul 18 16:55:56.352514 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 299/590] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:56 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:56.459466 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0b6ebf09-5a80-480b-8258-3e2fd153b38e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:56.467210 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0b6ebf09-5a80-480b-8258-3e2fd153b38e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.155313 Jul 18 16:55:56.471148 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 292/591] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:56 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:57.040240 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e5c2f91f-7d75-456a-a34c-3054f8319007 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:57.040861 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e5c2f91f-7d75-456a-a34c-3054f8319007 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:57.047260 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e5c2f91f-7d75-456a-a34c-3054f8319007 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:57.047711 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e5c2f91f-7d75-456a-a34c-3054f8319007 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:57.048500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e5c2f91f-7d75-456a-a34c-3054f8319007 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:57.048936 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e5c2f91f-7d75-456a-a34c-3054f8319007 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:57.187871 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e5c2f91f-7d75-456a-a34c-3054f8319007 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:57.191432 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:57.197771 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e5c2f91f-7d75-456a-a34c-3054f8319007 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.161418 Jul 18 16:55:57.198343 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 300/592] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:57 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:57.371522 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-88dd15d5-105f-4bf1-bb64-c2231f7c5782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:57.372130 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-88dd15d5-105f-4bf1-bb64-c2231f7c5782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:57.379421 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88dd15d5-105f-4bf1-bb64-c2231f7c5782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:57.386108 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88dd15d5-105f-4bf1-bb64-c2231f7c5782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:57.386108 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88dd15d5-105f-4bf1-bb64-c2231f7c5782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:57.386108 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88dd15d5-105f-4bf1-bb64-c2231f7c5782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:57.485564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-007288b3-5c08-427e-b759-794b3be999a4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:57.486459 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-007288b3-5c08-427e-b759-794b3be999a4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:57.492641 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-007288b3-5c08-427e-b759-794b3be999a4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:57.495290 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-007288b3-5c08-427e-b759-794b3be999a4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:57.495290 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-007288b3-5c08-427e-b759-794b3be999a4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:57.495290 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-007288b3-5c08-427e-b759-794b3be999a4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:57.518911 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-88dd15d5-105f-4bf1-bb64-c2231f7c5782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:57.528213 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-88dd15d5-105f-4bf1-bb64-c2231f7c5782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:57.529690 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-88dd15d5-105f-4bf1-bb64-c2231f7c5782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:57.531400 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-88dd15d5-105f-4bf1-bb64-c2231f7c5782 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.163733 Jul 18 16:55:57.531971 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 293/593] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:57 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:57.632225 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-007288b3-5c08-427e-b759-794b3be999a4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:57.640515 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-007288b3-5c08-427e-b759-794b3be999a4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.159855 Jul 18 16:55:57.641116 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 301/594] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:57 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:58.214932 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6afad903-8bfd-44b0-95f2-6bcad68697ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:58.215547 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6afad903-8bfd-44b0-95f2-6bcad68697ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:58.222849 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6afad903-8bfd-44b0-95f2-6bcad68697ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:58.223389 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6afad903-8bfd-44b0-95f2-6bcad68697ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:58.224370 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6afad903-8bfd-44b0-95f2-6bcad68697ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:58.224871 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6afad903-8bfd-44b0-95f2-6bcad68697ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:58.350193 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a4da9e0d-331a-4b83-b121-f307e1ab0edd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82fba666-ad36-4e50-bcb4-1d11a0f269db"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:58.351307 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a4da9e0d-331a-4b83-b121-f307e1ab0edd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:58.357771 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a4da9e0d-331a-4b83-b121-f307e1ab0edd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:58.358178 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a4da9e0d-331a-4b83-b121-f307e1ab0edd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:58.359471 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a4da9e0d-331a-4b83-b121-f307e1ab0edd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:58.360174 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a4da9e0d-331a-4b83-b121-f307e1ab0edd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:58.361639 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6afad903-8bfd-44b0-95f2-6bcad68697ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:58.369115 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6afad903-8bfd-44b0-95f2-6bcad68697ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.158094 Jul 18 16:55:58.369681 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 294/595] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:58 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:58.555470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-96d60577-bfa9-4bec-bf1b-0c80451559ca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:58.556221 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-96d60577-bfa9-4bec-bf1b-0c80451559ca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:58.562864 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96d60577-bfa9-4bec-bf1b-0c80451559ca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:58.563311 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96d60577-bfa9-4bec-bf1b-0c80451559ca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:58.564083 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96d60577-bfa9-4bec-bf1b-0c80451559ca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:58.564616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96d60577-bfa9-4bec-bf1b-0c80451559ca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:58.815540 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-96d60577-bfa9-4bec-bf1b-0c80451559ca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:58.824637 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-96d60577-bfa9-4bec-bf1b-0c80451559ca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:58.826184 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-96d60577-bfa9-4bec-bf1b-0c80451559ca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:58.828063 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-96d60577-bfa9-4bec-bf1b-0c80451559ca tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.280870 Jul 18 16:55:58.828627 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 295/596] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:58 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:55:58.833377 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c918b30e-ffcf-4c6c-aa04-1594b670fe5d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:58.833985 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c918b30e-ffcf-4c6c-aa04-1594b670fe5d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:58.840041 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c918b30e-ffcf-4c6c-aa04-1594b670fe5d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:58.840497 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c918b30e-ffcf-4c6c-aa04-1594b670fe5d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:58.842077 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c918b30e-ffcf-4c6c-aa04-1594b670fe5d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:58.842077 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c918b30e-ffcf-4c6c-aa04-1594b670fe5d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:59.184005 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c918b30e-ffcf-4c6c-aa04-1594b670fe5d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:59.192756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c918b30e-ffcf-4c6c-aa04-1594b670fe5d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.362961 Jul 18 16:55:59.193356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 296/597] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:58 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:59.234051 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a4da9e0d-331a-4b83-b121-f307e1ab0edd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "POST /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.887318 Jul 18 16:55:59.235163 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 302/598] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 16:55:58 2022] POST /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/os-volume_attachments => generated 194 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:59.386106 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-49cb045a-3b70-445d-96a9-03482823fdde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:59.386729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-49cb045a-3b70-445d-96a9-03482823fdde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:59.400331 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-49cb045a-3b70-445d-96a9-03482823fdde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:59.401123 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-49cb045a-3b70-445d-96a9-03482823fdde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:59.401923 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-49cb045a-3b70-445d-96a9-03482823fdde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:59.402371 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-49cb045a-3b70-445d-96a9-03482823fdde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:59.848282 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b698b502-0bcc-4a2d-92cb-a16d6d6156a6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:59.850155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b698b502-0bcc-4a2d-92cb-a16d6d6156a6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:59.859500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b698b502-0bcc-4a2d-92cb-a16d6d6156a6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:59.860590 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b698b502-0bcc-4a2d-92cb-a16d6d6156a6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:59.861716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b698b502-0bcc-4a2d-92cb-a16d6d6156a6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:59.862402 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b698b502-0bcc-4a2d-92cb-a16d6d6156a6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:59.903656 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-49cb045a-3b70-445d-96a9-03482823fdde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:59.912903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-49cb045a-3b70-445d-96a9-03482823fdde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.530524 Jul 18 16:55:59.914137 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 297/599] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:59 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:00.015718 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b698b502-0bcc-4a2d-92cb-a16d6d6156a6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:00.026144 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b698b502-0bcc-4a2d-92cb-a16d6d6156a6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:00.027662 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b698b502-0bcc-4a2d-92cb-a16d6d6156a6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:00.028838 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b698b502-0bcc-4a2d-92cb-a16d6d6156a6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.185888 Jul 18 16:56:00.029434 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 303/600] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:55:59 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:00.210501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c21faf7d-dd8f-40cc-adb8-f7d2394a8ab2 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:00.211194 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c21faf7d-dd8f-40cc-adb8-f7d2394a8ab2 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:00.218841 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c21faf7d-dd8f-40cc-adb8-f7d2394a8ab2 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:00.219480 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c21faf7d-dd8f-40cc-adb8-f7d2394a8ab2 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:00.220288 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c21faf7d-dd8f-40cc-adb8-f7d2394a8ab2 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:00.220775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c21faf7d-dd8f-40cc-adb8-f7d2394a8ab2 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:00.223523 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:00.364009 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c21faf7d-dd8f-40cc-adb8-f7d2394a8ab2 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:00.371522 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c21faf7d-dd8f-40cc-adb8-f7d2394a8ab2 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.165241 Jul 18 16:56:00.372083 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 298/601] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:00 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:00.931350 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e874ff38-4715-4470-8787-69eeb7f4c515 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:00.931988 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e874ff38-4715-4470-8787-69eeb7f4c515 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:00.939254 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e874ff38-4715-4470-8787-69eeb7f4c515 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:00.939712 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e874ff38-4715-4470-8787-69eeb7f4c515 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:00.940492 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e874ff38-4715-4470-8787-69eeb7f4c515 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:00.940927 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e874ff38-4715-4470-8787-69eeb7f4c515 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:01.048717 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-43643e20-c9f5-4730-b160-da7e1252637e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:01.049633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-43643e20-c9f5-4730-b160-da7e1252637e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:01.057140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43643e20-c9f5-4730-b160-da7e1252637e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:01.057140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43643e20-c9f5-4730-b160-da7e1252637e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:01.057833 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43643e20-c9f5-4730-b160-da7e1252637e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:01.058307 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43643e20-c9f5-4730-b160-da7e1252637e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:01.077807 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e874ff38-4715-4470-8787-69eeb7f4c515 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:01.085319 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e874ff38-4715-4470-8787-69eeb7f4c515 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.157846 Jul 18 16:56:01.085893 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 304/602] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:00 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:01.193339 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-43643e20-c9f5-4730-b160-da7e1252637e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:01.201868 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-43643e20-c9f5-4730-b160-da7e1252637e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:01.203400 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-43643e20-c9f5-4730-b160-da7e1252637e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:01.204564 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-43643e20-c9f5-4730-b160-da7e1252637e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.160995 Jul 18 16:56:01.205143 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 299/603] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:01 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:01.388692 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-41e20b33-0938-4d9a-b131-7877997fe461 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:01.389328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-41e20b33-0938-4d9a-b131-7877997fe461 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:01.395587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41e20b33-0938-4d9a-b131-7877997fe461 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:01.396031 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41e20b33-0938-4d9a-b131-7877997fe461 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:01.396803 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41e20b33-0938-4d9a-b131-7877997fe461 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:01.397273 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41e20b33-0938-4d9a-b131-7877997fe461 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:01.527057 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-41e20b33-0938-4d9a-b131-7877997fe461 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:01.535299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-41e20b33-0938-4d9a-b131-7877997fe461 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.150362 Jul 18 16:56:01.535863 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 305/604] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:01 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:02.102618 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8ff81cc5-2dbb-4360-9be2-7e71c68c29ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:02.103249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8ff81cc5-2dbb-4360-9be2-7e71c68c29ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:02.109862 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8ff81cc5-2dbb-4360-9be2-7e71c68c29ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:02.110591 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8ff81cc5-2dbb-4360-9be2-7e71c68c29ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:02.111345 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8ff81cc5-2dbb-4360-9be2-7e71c68c29ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:02.111778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8ff81cc5-2dbb-4360-9be2-7e71c68c29ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:02.222564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-18905ec0-ca41-4c15-8ee7-aa09ea79ae64 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:02.223168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-18905ec0-ca41-4c15-8ee7-aa09ea79ae64 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:02.229946 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18905ec0-ca41-4c15-8ee7-aa09ea79ae64 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:02.230398 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18905ec0-ca41-4c15-8ee7-aa09ea79ae64 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:02.231367 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18905ec0-ca41-4c15-8ee7-aa09ea79ae64 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:02.231805 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18905ec0-ca41-4c15-8ee7-aa09ea79ae64 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:02.253578 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8ff81cc5-2dbb-4360-9be2-7e71c68c29ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:02.261293 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8ff81cc5-2dbb-4360-9be2-7e71c68c29ea tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.162440 Jul 18 16:56:02.261865 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 300/605] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:02 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:02.374772 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-18905ec0-ca41-4c15-8ee7-aa09ea79ae64 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:02.383690 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-18905ec0-ca41-4c15-8ee7-aa09ea79ae64 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:02.385337 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-18905ec0-ca41-4c15-8ee7-aa09ea79ae64 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:02.391904 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-18905ec0-ca41-4c15-8ee7-aa09ea79ae64 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.168083 Jul 18 16:56:02.391904 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 306/606] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:02 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:56:02.459619 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-fc10a9d5-6b74-49c2-a53d-648a72de6b6e req-32e8739e-e86f-4582-8dac-fa5b1dd16b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a961f74-97c0-4862-a288-ff06a9aa55e9", "name": "network-vif-plugged", "status": "completed", "tag": "ccdc3f7f-7e82-4dab-94cd-51b784a19c64"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:02.467928 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-fc10a9d5-6b74-49c2-a53d-648a72de6b6e req-32e8739e-e86f-4582-8dac-fa5b1dd16b7f service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:02.468372 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-fc10a9d5-6b74-49c2-a53d-648a72de6b6e req-32e8739e-e86f-4582-8dac-fa5b1dd16b7f service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:02.479202 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-fc10a9d5-6b74-49c2-a53d-648a72de6b6e req-32e8739e-e86f-4582-8dac-fa5b1dd16b7f service nova] Creating event network-vif-plugged:ccdc3f7f-7e82-4dab-94cd-51b784a19c64 for instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 on hv-cinder-83754 Jul 18 16:56:02.485271 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-fc10a9d5-6b74-49c2-a53d-648a72de6b6e req-32e8739e-e86f-4582-8dac-fa5b1dd16b7f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037749 Jul 18 16:56:02.485860 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 301/607] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:02.552455 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ff65c5ec-529f-4cf0-8256-83035fb8f173 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:02.553198 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ff65c5ec-529f-4cf0-8256-83035fb8f173 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:02.559677 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff65c5ec-529f-4cf0-8256-83035fb8f173 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:02.560137 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff65c5ec-529f-4cf0-8256-83035fb8f173 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:02.560915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff65c5ec-529f-4cf0-8256-83035fb8f173 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:02.561384 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff65c5ec-529f-4cf0-8256-83035fb8f173 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:02.694702 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ff65c5ec-529f-4cf0-8256-83035fb8f173 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:02.702074 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ff65c5ec-529f-4cf0-8256-83035fb8f173 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.153725 Jul 18 16:56:02.702734 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 307/608] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:02 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:03.280458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b49abec5-ded8-4f97-a71b-fade5db47e85 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:03.281289 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b49abec5-ded8-4f97-a71b-fade5db47e85 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:03.287507 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b49abec5-ded8-4f97-a71b-fade5db47e85 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:03.287960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b49abec5-ded8-4f97-a71b-fade5db47e85 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:03.289055 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b49abec5-ded8-4f97-a71b-fade5db47e85 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:03.289218 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b49abec5-ded8-4f97-a71b-fade5db47e85 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:03.408110 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c8670ce9-87a0-4e93-ae2e-5cb99d5140e7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:03.409484 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c8670ce9-87a0-4e93-ae2e-5cb99d5140e7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:03.417282 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c8670ce9-87a0-4e93-ae2e-5cb99d5140e7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:03.418161 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c8670ce9-87a0-4e93-ae2e-5cb99d5140e7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:03.419124 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c8670ce9-87a0-4e93-ae2e-5cb99d5140e7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:03.419720 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c8670ce9-87a0-4e93-ae2e-5cb99d5140e7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:03.559299 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b49abec5-ded8-4f97-a71b-fade5db47e85 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:03.585600 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b49abec5-ded8-4f97-a71b-fade5db47e85 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.296070 Jul 18 16:56:03.585600 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 302/609] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:03 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:03.585872 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c8670ce9-87a0-4e93-ae2e-5cb99d5140e7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:03.590054 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c8670ce9-87a0-4e93-ae2e-5cb99d5140e7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:03.592421 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c8670ce9-87a0-4e93-ae2e-5cb99d5140e7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:03.594541 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c8670ce9-87a0-4e93-ae2e-5cb99d5140e7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.191914 Jul 18 16:56:03.601045 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 308/610] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:03 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:03.719706 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-56a424be-c4ea-4aab-a3f4-d07c0b4adaf4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:03.720321 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-56a424be-c4ea-4aab-a3f4-d07c0b4adaf4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:03.733328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-56a424be-c4ea-4aab-a3f4-d07c0b4adaf4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:03.734522 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-56a424be-c4ea-4aab-a3f4-d07c0b4adaf4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:03.735985 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-56a424be-c4ea-4aab-a3f4-d07c0b4adaf4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:03.736563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-56a424be-c4ea-4aab-a3f4-d07c0b4adaf4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:03.929600 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-56a424be-c4ea-4aab-a3f4-d07c0b4adaf4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:03.934506 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-56a424be-c4ea-4aab-a3f4-d07c0b4adaf4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.219185 Jul 18 16:56:03.935185 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 303/611] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:03 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:04.591690 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6172bc99-2902-4260-b18e-0bc13742e205 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:04.593129 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6172bc99-2902-4260-b18e-0bc13742e205 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:04.600335 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6172bc99-2902-4260-b18e-0bc13742e205 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.600793 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6172bc99-2902-4260-b18e-0bc13742e205 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:04.601605 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6172bc99-2902-4260-b18e-0bc13742e205 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.602420 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6172bc99-2902-4260-b18e-0bc13742e205 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:04.617103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0750306c-73d5-461b-8c97-3c5d90cb59e8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:04.617949 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0750306c-73d5-461b-8c97-3c5d90cb59e8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:04.735697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0750306c-73d5-461b-8c97-3c5d90cb59e8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.735697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0750306c-73d5-461b-8c97-3c5d90cb59e8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:04.735697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0750306c-73d5-461b-8c97-3c5d90cb59e8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.735697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0750306c-73d5-461b-8c97-3c5d90cb59e8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:04.753897 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6172bc99-2902-4260-b18e-0bc13742e205 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:04.769800 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6172bc99-2902-4260-b18e-0bc13742e205 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.181685 Jul 18 16:56:04.772948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 309/612] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:04 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:04.817487 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0750306c-73d5-461b-8c97-3c5d90cb59e8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:04.828606 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0750306c-73d5-461b-8c97-3c5d90cb59e8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:04.830173 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0750306c-73d5-461b-8c97-3c5d90cb59e8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:04.831391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0750306c-73d5-461b-8c97-3c5d90cb59e8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.221279 Jul 18 16:56:04.831953 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 304/613] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:04 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:56:04.951476 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b7119160-754e-453d-9ec5-00f08b85be6c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:04.952127 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b7119160-754e-453d-9ec5-00f08b85be6c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:04.959227 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b7119160-754e-453d-9ec5-00f08b85be6c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.960279 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b7119160-754e-453d-9ec5-00f08b85be6c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:04.961336 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b7119160-754e-453d-9ec5-00f08b85be6c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.961966 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b7119160-754e-453d-9ec5-00f08b85be6c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:05.110623 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b7119160-754e-453d-9ec5-00f08b85be6c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:05.118648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b7119160-754e-453d-9ec5-00f08b85be6c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.171360 Jul 18 16:56:05.119235 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 310/614] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:04 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:05.787714 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-724482f9-3b0b-4fc9-8c2b-0db24e2e5a3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:05.788422 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-724482f9-3b0b-4fc9-8c2b-0db24e2e5a3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:05.790877 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=82 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:05.796043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-724482f9-3b0b-4fc9-8c2b-0db24e2e5a3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:05.802735 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-724482f9-3b0b-4fc9-8c2b-0db24e2e5a3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:05.802735 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-724482f9-3b0b-4fc9-8c2b-0db24e2e5a3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:05.802735 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-724482f9-3b0b-4fc9-8c2b-0db24e2e5a3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:05.850930 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3b287d1f-399d-4633-9785-07ea75ad7a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:05.851616 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3b287d1f-399d-4633-9785-07ea75ad7a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:05.859244 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3b287d1f-399d-4633-9785-07ea75ad7a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:05.859636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3b287d1f-399d-4633-9785-07ea75ad7a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:05.860795 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3b287d1f-399d-4633-9785-07ea75ad7a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:05.861373 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3b287d1f-399d-4633-9785-07ea75ad7a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:05.944074 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-724482f9-3b0b-4fc9-8c2b-0db24e2e5a3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:05.952480 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-724482f9-3b0b-4fc9-8c2b-0db24e2e5a3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.168509 Jul 18 16:56:05.955821 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 305/615] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:05 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:06.006922 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3b287d1f-399d-4633-9785-07ea75ad7a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:06.016645 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3b287d1f-399d-4633-9785-07ea75ad7a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:06.018347 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3b287d1f-399d-4633-9785-07ea75ad7a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:06.019553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3b287d1f-399d-4633-9785-07ea75ad7a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.172549 Jul 18 16:56:06.020119 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 311/616] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:05 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:06.135980 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-45107e4b-919b-421f-a65a-8c0f92e288f3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:06.136638 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-45107e4b-919b-421f-a65a-8c0f92e288f3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:06.144179 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45107e4b-919b-421f-a65a-8c0f92e288f3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:06.145820 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45107e4b-919b-421f-a65a-8c0f92e288f3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:06.145820 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45107e4b-919b-421f-a65a-8c0f92e288f3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:06.147966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45107e4b-919b-421f-a65a-8c0f92e288f3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:06.292477 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-45107e4b-919b-421f-a65a-8c0f92e288f3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:06.301174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-45107e4b-919b-421f-a65a-8c0f92e288f3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.169152 Jul 18 16:56:06.302028 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 306/617] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:06 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:06.972018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2ef7b54b-c8e1-4acd-a0ed-4387dee6f70b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:06.972603 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2ef7b54b-c8e1-4acd-a0ed-4387dee6f70b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:06.979547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ef7b54b-c8e1-4acd-a0ed-4387dee6f70b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:06.980008 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ef7b54b-c8e1-4acd-a0ed-4387dee6f70b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:06.980793 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ef7b54b-c8e1-4acd-a0ed-4387dee6f70b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:06.981259 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ef7b54b-c8e1-4acd-a0ed-4387dee6f70b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:07.039215 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c294bcdc-d605-40c4-a7c3-cdc9aa66118d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:07.040087 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c294bcdc-d605-40c4-a7c3-cdc9aa66118d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:07.048804 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c294bcdc-d605-40c4-a7c3-cdc9aa66118d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:07.049287 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c294bcdc-d605-40c4-a7c3-cdc9aa66118d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:07.050112 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c294bcdc-d605-40c4-a7c3-cdc9aa66118d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:07.050542 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c294bcdc-d605-40c4-a7c3-cdc9aa66118d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:07.156813 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2ef7b54b-c8e1-4acd-a0ed-4387dee6f70b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:07.180612 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2ef7b54b-c8e1-4acd-a0ed-4387dee6f70b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.211939 Jul 18 16:56:07.183401 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 312/618] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:06 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:07.231907 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c294bcdc-d605-40c4-a7c3-cdc9aa66118d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:07.242621 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c294bcdc-d605-40c4-a7c3-cdc9aa66118d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:07.244143 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c294bcdc-d605-40c4-a7c3-cdc9aa66118d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:07.245406 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c294bcdc-d605-40c4-a7c3-cdc9aa66118d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.210225 Jul 18 16:56:07.245974 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 307/619] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:07 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:07.320759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-50369a95-7595-4413-af9f-580fff3a84e9 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:07.321503 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-50369a95-7595-4413-af9f-580fff3a84e9 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:07.329768 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-50369a95-7595-4413-af9f-580fff3a84e9 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:07.330452 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-50369a95-7595-4413-af9f-580fff3a84e9 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:07.331420 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-50369a95-7595-4413-af9f-580fff3a84e9 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:07.332296 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-50369a95-7595-4413-af9f-580fff3a84e9 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:07.449348 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-abf780e3-865a-4823-b8eb-5b9110d151ea req-d0925ee6-25b2-486d-a7d2-ea590ae1dc68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb84650-2a5a-491b-a7fd-2b80fc1b8c57", "name": "network-vif-plugged", "status": "completed", "tag": "ffbf241e-13b6-4507-9161-8a88eafc095a"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:07.461680 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-abf780e3-865a-4823-b8eb-5b9110d151ea req-d0925ee6-25b2-486d-a7d2-ea590ae1dc68 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:07.462282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-abf780e3-865a-4823-b8eb-5b9110d151ea req-d0925ee6-25b2-486d-a7d2-ea590ae1dc68 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:07.474922 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-abf780e3-865a-4823-b8eb-5b9110d151ea req-d0925ee6-25b2-486d-a7d2-ea590ae1dc68 service nova] Creating event network-vif-plugged:ffbf241e-13b6-4507-9161-8a88eafc095a for instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 on hv-cinder-83754 Jul 18 16:56:07.480268 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-abf780e3-865a-4823-b8eb-5b9110d151ea req-d0925ee6-25b2-486d-a7d2-ea590ae1dc68 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038955 Jul 18 16:56:07.480709 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-50369a95-7595-4413-af9f-580fff3a84e9 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:07.481197 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 308/620] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:56:07.492389 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-50369a95-7595-4413-af9f-580fff3a84e9 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.177124 Jul 18 16:56:07.493252 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 313/621] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:07 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:08.200276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2dd9eef8-acd0-4f4e-bbc1-92bb6080d1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:08.200972 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2dd9eef8-acd0-4f4e-bbc1-92bb6080d1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:08.208173 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2dd9eef8-acd0-4f4e-bbc1-92bb6080d1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:08.208627 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2dd9eef8-acd0-4f4e-bbc1-92bb6080d1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:08.210057 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2dd9eef8-acd0-4f4e-bbc1-92bb6080d1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:08.210508 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2dd9eef8-acd0-4f4e-bbc1-92bb6080d1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:08.266386 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-67f059ba-7e9e-4bfe-8b68-0c03e036256d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:08.267745 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-67f059ba-7e9e-4bfe-8b68-0c03e036256d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:08.274961 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-67f059ba-7e9e-4bfe-8b68-0c03e036256d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:08.275783 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-67f059ba-7e9e-4bfe-8b68-0c03e036256d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:08.276758 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-67f059ba-7e9e-4bfe-8b68-0c03e036256d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:08.277234 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-67f059ba-7e9e-4bfe-8b68-0c03e036256d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:08.366434 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2dd9eef8-acd0-4f4e-bbc1-92bb6080d1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:08.374547 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2dd9eef8-acd0-4f4e-bbc1-92bb6080d1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.178532 Jul 18 16:56:08.375743 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 309/622] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:08 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:08.429837 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-67f059ba-7e9e-4bfe-8b68-0c03e036256d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:08.439879 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-67f059ba-7e9e-4bfe-8b68-0c03e036256d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:08.441453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-67f059ba-7e9e-4bfe-8b68-0c03e036256d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:08.442637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-67f059ba-7e9e-4bfe-8b68-0c03e036256d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.181057 Jul 18 16:56:08.443199 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 314/623] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:08 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:08.510832 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-49f6afa6-5ed8-45e2-9002-e8eaf196ef98 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:08.511456 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-49f6afa6-5ed8-45e2-9002-e8eaf196ef98 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:08.518341 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-49f6afa6-5ed8-45e2-9002-e8eaf196ef98 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:08.518800 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-49f6afa6-5ed8-45e2-9002-e8eaf196ef98 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:08.519583 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-49f6afa6-5ed8-45e2-9002-e8eaf196ef98 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:08.520022 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-49f6afa6-5ed8-45e2-9002-e8eaf196ef98 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:08.662095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-49f6afa6-5ed8-45e2-9002-e8eaf196ef98 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:08.669798 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-49f6afa6-5ed8-45e2-9002-e8eaf196ef98 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.162781 Jul 18 16:56:08.670714 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 310/624] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:08 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:09.390962 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-941bcb1d-deb5-473a-bf5f-1a4d3286c0a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:09.391582 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-941bcb1d-deb5-473a-bf5f-1a4d3286c0a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:09.398321 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-941bcb1d-deb5-473a-bf5f-1a4d3286c0a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:09.398774 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-941bcb1d-deb5-473a-bf5f-1a4d3286c0a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:09.399553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-941bcb1d-deb5-473a-bf5f-1a4d3286c0a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:09.399995 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-941bcb1d-deb5-473a-bf5f-1a4d3286c0a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:09.461087 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-573cb21b-6fb1-4613-b260-5887a825e78c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:09.461656 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-573cb21b-6fb1-4613-b260-5887a825e78c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:09.471409 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-573cb21b-6fb1-4613-b260-5887a825e78c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:09.472559 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-573cb21b-6fb1-4613-b260-5887a825e78c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:09.473400 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-573cb21b-6fb1-4613-b260-5887a825e78c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:09.473996 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-573cb21b-6fb1-4613-b260-5887a825e78c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:09.551679 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-941bcb1d-deb5-473a-bf5f-1a4d3286c0a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:09.559901 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-941bcb1d-deb5-473a-bf5f-1a4d3286c0a4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.172761 Jul 18 16:56:09.560496 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 315/625] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:09 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:09.621952 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-573cb21b-6fb1-4613-b260-5887a825e78c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:09.631222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-573cb21b-6fb1-4613-b260-5887a825e78c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:09.632863 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-573cb21b-6fb1-4613-b260-5887a825e78c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:09.634150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-573cb21b-6fb1-4613-b260-5887a825e78c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.177168 Jul 18 16:56:09.634788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 311/626] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:09 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:56:09.687480 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4c3ed543-5b30-435f-9acc-08e1c9c7582e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:09.688329 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4c3ed543-5b30-435f-9acc-08e1c9c7582e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:09.694499 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4c3ed543-5b30-435f-9acc-08e1c9c7582e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:09.694951 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4c3ed543-5b30-435f-9acc-08e1c9c7582e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:09.695731 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4c3ed543-5b30-435f-9acc-08e1c9c7582e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:09.696166 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4c3ed543-5b30-435f-9acc-08e1c9c7582e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:09.699070 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:09.840606 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4c3ed543-5b30-435f-9acc-08e1c9c7582e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:09.848721 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4c3ed543-5b30-435f-9acc-08e1c9c7582e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.165246 Jul 18 16:56:09.849533 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 316/627] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:09 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:10.577867 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7e314125-bbd9-4988-9be0-d30bc07cbac7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:10.578622 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7e314125-bbd9-4988-9be0-d30bc07cbac7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:10.585039 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7e314125-bbd9-4988-9be0-d30bc07cbac7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:10.585494 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7e314125-bbd9-4988-9be0-d30bc07cbac7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:10.586290 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7e314125-bbd9-4988-9be0-d30bc07cbac7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:10.586726 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7e314125-bbd9-4988-9be0-d30bc07cbac7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:10.651925 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-09e2ac7c-2b20-4966-92bd-81374846aa9c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:10.652530 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-09e2ac7c-2b20-4966-92bd-81374846aa9c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:10.660226 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-09e2ac7c-2b20-4966-92bd-81374846aa9c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:10.660755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-09e2ac7c-2b20-4966-92bd-81374846aa9c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:10.661565 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-09e2ac7c-2b20-4966-92bd-81374846aa9c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:10.662163 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-09e2ac7c-2b20-4966-92bd-81374846aa9c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:10.818353 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7e314125-bbd9-4988-9be0-d30bc07cbac7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:10.821386 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-09e2ac7c-2b20-4966-92bd-81374846aa9c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:10.826290 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7e314125-bbd9-4988-9be0-d30bc07cbac7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.252870 Jul 18 16:56:10.827707 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 312/628] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:10 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:10.831189 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-09e2ac7c-2b20-4966-92bd-81374846aa9c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:10.834653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-09e2ac7c-2b20-4966-92bd-81374846aa9c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:10.835856 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-09e2ac7c-2b20-4966-92bd-81374846aa9c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.187950 Jul 18 16:56:10.836415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 317/629] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:10 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:56:10.866017 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-471a4726-57cb-41ba-8f46-e0e0b93ffc22 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:10.866620 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-471a4726-57cb-41ba-8f46-e0e0b93ffc22 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:10.872989 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-471a4726-57cb-41ba-8f46-e0e0b93ffc22 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:10.873462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-471a4726-57cb-41ba-8f46-e0e0b93ffc22 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:10.874488 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-471a4726-57cb-41ba-8f46-e0e0b93ffc22 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:10.875139 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-471a4726-57cb-41ba-8f46-e0e0b93ffc22 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:11.032177 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-471a4726-57cb-41ba-8f46-e0e0b93ffc22 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:11.040154 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-471a4726-57cb-41ba-8f46-e0e0b93ffc22 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.177852 Jul 18 16:56:11.040733 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 313/630] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:10 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:11.845305 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e2883527-b870-415f-b9ab-2d26166cc4bd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:11.845987 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e2883527-b870-415f-b9ab-2d26166cc4bd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:11.856366 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e2883527-b870-415f-b9ab-2d26166cc4bd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:11.857123 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e2883527-b870-415f-b9ab-2d26166cc4bd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:11.859101 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e2883527-b870-415f-b9ab-2d26166cc4bd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:11.859894 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e2883527-b870-415f-b9ab-2d26166cc4bd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:11.860431 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5e8e870a-afdd-425e-a80e-4ae695458d5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:11.861471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5e8e870a-afdd-425e-a80e-4ae695458d5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:11.872690 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5e8e870a-afdd-425e-a80e-4ae695458d5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:11.875855 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5e8e870a-afdd-425e-a80e-4ae695458d5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:11.877175 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5e8e870a-afdd-425e-a80e-4ae695458d5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:11.878225 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5e8e870a-afdd-425e-a80e-4ae695458d5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:12.082674 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e2883527-b870-415f-b9ab-2d26166cc4bd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:12.089201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5e8e870a-afdd-425e-a80e-4ae695458d5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:12.091100 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e2883527-b870-415f-b9ab-2d26166cc4bd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.250722 Jul 18 16:56:12.091872 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 318/631] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:11 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:12.097046 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-93e5d548-fe09-41ec-85a5-cc9f682257eb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:12.097596 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-93e5d548-fe09-41ec-85a5-cc9f682257eb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:12.100374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5e8e870a-afdd-425e-a80e-4ae695458d5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:12.102520 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5e8e870a-afdd-425e-a80e-4ae695458d5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:12.103752 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-93e5d548-fe09-41ec-85a5-cc9f682257eb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:12.104362 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-93e5d548-fe09-41ec-85a5-cc9f682257eb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:12.104493 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5e8e870a-afdd-425e-a80e-4ae695458d5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.251860 Jul 18 16:56:12.105160 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 314/632] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:11 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:56:12.116708 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-93e5d548-fe09-41ec-85a5-cc9f682257eb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:12.117314 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-93e5d548-fe09-41ec-85a5-cc9f682257eb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:12.281806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-93e5d548-fe09-41ec-85a5-cc9f682257eb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:12.294552 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-93e5d548-fe09-41ec-85a5-cc9f682257eb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.201744 Jul 18 16:56:12.295165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 319/633] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:12 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:13.107809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-48cda924-b1eb-4154-83a6-235db669f11f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:13.108992 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-48cda924-b1eb-4154-83a6-235db669f11f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:13.116175 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48cda924-b1eb-4154-83a6-235db669f11f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:13.116735 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48cda924-b1eb-4154-83a6-235db669f11f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:13.117626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48cda924-b1eb-4154-83a6-235db669f11f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:13.118067 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48cda924-b1eb-4154-83a6-235db669f11f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:13.123696 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fe37d28f-6d49-4253-925c-175fab104a19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:13.125492 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fe37d28f-6d49-4253-925c-175fab104a19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:13.135016 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe37d28f-6d49-4253-925c-175fab104a19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:13.135603 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe37d28f-6d49-4253-925c-175fab104a19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:13.136558 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe37d28f-6d49-4253-925c-175fab104a19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:13.137111 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe37d28f-6d49-4253-925c-175fab104a19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:13.285866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-48cda924-b1eb-4154-83a6-235db669f11f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:13.293522 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-48cda924-b1eb-4154-83a6-235db669f11f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.189380 Jul 18 16:56:13.294416 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 315/634] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:13 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:13.303615 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fe37d28f-6d49-4253-925c-175fab104a19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:13.312554 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1ce30b64-b7b7-42c2-ac2c-f468c70f933d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:13.313185 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fe37d28f-6d49-4253-925c-175fab104a19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:13.313808 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1ce30b64-b7b7-42c2-ac2c-f468c70f933d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:13.314721 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fe37d28f-6d49-4253-925c-175fab104a19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:13.315933 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fe37d28f-6d49-4253-925c-175fab104a19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.196105 Jul 18 16:56:13.316439 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 320/635] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:13 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:13.321053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1ce30b64-b7b7-42c2-ac2c-f468c70f933d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:13.321509 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1ce30b64-b7b7-42c2-ac2c-f468c70f933d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:13.322407 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1ce30b64-b7b7-42c2-ac2c-f468c70f933d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:13.322843 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1ce30b64-b7b7-42c2-ac2c-f468c70f933d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:13.325836 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:13.461372 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1ce30b64-b7b7-42c2-ac2c-f468c70f933d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:13.469771 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1ce30b64-b7b7-42c2-ac2c-f468c70f933d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.161347 Jul 18 16:56:13.470352 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 316/636] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:13 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:14.310927 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d08ce34c-72c6-4f42-99fe-27ff887a7124 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:14.311664 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d08ce34c-72c6-4f42-99fe-27ff887a7124 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:14.318906 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d08ce34c-72c6-4f42-99fe-27ff887a7124 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:14.319351 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d08ce34c-72c6-4f42-99fe-27ff887a7124 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:14.320109 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d08ce34c-72c6-4f42-99fe-27ff887a7124 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:14.320541 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d08ce34c-72c6-4f42-99fe-27ff887a7124 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:14.336286 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d0f70c60-7d3c-4480-b233-e5b188e22814 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:14.336913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d0f70c60-7d3c-4480-b233-e5b188e22814 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:14.344613 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d0f70c60-7d3c-4480-b233-e5b188e22814 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:14.345121 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d0f70c60-7d3c-4480-b233-e5b188e22814 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:14.346001 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d0f70c60-7d3c-4480-b233-e5b188e22814 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:14.346531 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d0f70c60-7d3c-4480-b233-e5b188e22814 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:14.495801 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d0f70c60-7d3c-4480-b233-e5b188e22814 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:14.504794 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d0f70c60-7d3c-4480-b233-e5b188e22814 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:14.506370 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d0f70c60-7d3c-4480-b233-e5b188e22814 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:14.507542 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d0f70c60-7d3c-4480-b233-e5b188e22814 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.176747 Jul 18 16:56:14.508103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 317/637] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:14 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:56:14.512468 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-414fb1f8-9aa9-4f96-80ed-24c10b0c011c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:14.513221 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-414fb1f8-9aa9-4f96-80ed-24c10b0c011c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:14.520095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-414fb1f8-9aa9-4f96-80ed-24c10b0c011c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:14.520566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-414fb1f8-9aa9-4f96-80ed-24c10b0c011c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:14.521454 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-414fb1f8-9aa9-4f96-80ed-24c10b0c011c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:14.521590 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d08ce34c-72c6-4f42-99fe-27ff887a7124 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:14.521900 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-414fb1f8-9aa9-4f96-80ed-24c10b0c011c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:14.533596 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d08ce34c-72c6-4f42-99fe-27ff887a7124 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.226445 Jul 18 16:56:14.534168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 321/638] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:14 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:14.659668 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-414fb1f8-9aa9-4f96-80ed-24c10b0c011c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:14.667351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-414fb1f8-9aa9-4f96-80ed-24c10b0c011c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.158187 Jul 18 16:56:14.671766 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 318/639] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:14 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:15.526150 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-12c38d75-d5fe-4e91-8997-f285dd7404d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:15.526784 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-12c38d75-d5fe-4e91-8997-f285dd7404d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:15.534060 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12c38d75-d5fe-4e91-8997-f285dd7404d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:15.534504 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12c38d75-d5fe-4e91-8997-f285dd7404d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:15.535259 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12c38d75-d5fe-4e91-8997-f285dd7404d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:15.535714 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12c38d75-d5fe-4e91-8997-f285dd7404d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:15.550736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-87f52cee-5a00-4794-87b7-0f08779827e9 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:15.557656 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-87f52cee-5a00-4794-87b7-0f08779827e9 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:15.558004 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87f52cee-5a00-4794-87b7-0f08779827e9 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:15.558457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87f52cee-5a00-4794-87b7-0f08779827e9 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:15.559225 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87f52cee-5a00-4794-87b7-0f08779827e9 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:15.559667 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87f52cee-5a00-4794-87b7-0f08779827e9 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:15.673504 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-12c38d75-d5fe-4e91-8997-f285dd7404d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:15.682144 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-12c38d75-d5fe-4e91-8997-f285dd7404d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:15.683678 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-12c38d75-d5fe-4e91-8997-f285dd7404d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:15.684843 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-12c38d75-d5fe-4e91-8997-f285dd7404d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.162653 Jul 18 16:56:15.685445 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 322/640] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:15 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:15.689923 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b2113586-b0af-42a2-981e-409e933d2016 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:15.690522 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b2113586-b0af-42a2-981e-409e933d2016 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:15.696729 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b2113586-b0af-42a2-981e-409e933d2016 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:15.697217 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b2113586-b0af-42a2-981e-409e933d2016 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:15.697986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b2113586-b0af-42a2-981e-409e933d2016 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:15.698424 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b2113586-b0af-42a2-981e-409e933d2016 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:15.704641 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-87f52cee-5a00-4794-87b7-0f08779827e9 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:15.711979 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-87f52cee-5a00-4794-87b7-0f08779827e9 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.165037 Jul 18 16:56:15.712540 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 319/641] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:15 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:15.831565 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b2113586-b0af-42a2-981e-409e933d2016 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:15.838877 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b2113586-b0af-42a2-981e-409e933d2016 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.152497 Jul 18 16:56:15.839437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 323/642] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:15 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:16.704186 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ea99a045-1686-43b7-adc6-5e3f9435f167 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:16.704724 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ea99a045-1686-43b7-adc6-5e3f9435f167 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:16.711237 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea99a045-1686-43b7-adc6-5e3f9435f167 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:16.711693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea99a045-1686-43b7-adc6-5e3f9435f167 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:16.712462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea99a045-1686-43b7-adc6-5e3f9435f167 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:16.712914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea99a045-1686-43b7-adc6-5e3f9435f167 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:16.729649 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-51dad65a-273f-409a-a715-3615e9d73d74 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:16.730259 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-51dad65a-273f-409a-a715-3615e9d73d74 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:16.737184 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-51dad65a-273f-409a-a715-3615e9d73d74 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:16.737643 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-51dad65a-273f-409a-a715-3615e9d73d74 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:16.738444 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-51dad65a-273f-409a-a715-3615e9d73d74 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:16.738886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-51dad65a-273f-409a-a715-3615e9d73d74 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:16.854109 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ea99a045-1686-43b7-adc6-5e3f9435f167 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:16.859570 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ea99a045-1686-43b7-adc6-5e3f9435f167 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:16.861396 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ea99a045-1686-43b7-adc6-5e3f9435f167 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:16.862560 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ea99a045-1686-43b7-adc6-5e3f9435f167 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.163045 Jul 18 16:56:16.863128 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 320/643] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:16 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:16.867672 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-837b1a01-1445-466d-a31a-7218a6471e2e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:16.868265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-837b1a01-1445-466d-a31a-7218a6471e2e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:16.873349 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-51dad65a-273f-409a-a715-3615e9d73d74 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:16.875188 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-837b1a01-1445-466d-a31a-7218a6471e2e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:16.875652 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-837b1a01-1445-466d-a31a-7218a6471e2e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:16.876531 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-837b1a01-1445-466d-a31a-7218a6471e2e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:16.876865 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-837b1a01-1445-466d-a31a-7218a6471e2e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:16.881520 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-51dad65a-273f-409a-a715-3615e9d73d74 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.155588 Jul 18 16:56:16.882273 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 324/644] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:16 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:17.012794 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-837b1a01-1445-466d-a31a-7218a6471e2e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:17.021259 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-837b1a01-1445-466d-a31a-7218a6471e2e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.157086 Jul 18 16:56:17.021862 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 321/645] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:16 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:17.880563 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cf8a6dea-d2ce-4b00-8031-c2b11d6a0795 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:17.881209 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cf8a6dea-d2ce-4b00-8031-c2b11d6a0795 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:17.887707 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cf8a6dea-d2ce-4b00-8031-c2b11d6a0795 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:17.888157 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cf8a6dea-d2ce-4b00-8031-c2b11d6a0795 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:17.888922 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cf8a6dea-d2ce-4b00-8031-c2b11d6a0795 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:17.889444 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cf8a6dea-d2ce-4b00-8031-c2b11d6a0795 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:17.898257 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fadac99c-884d-40ec-a704-6714f2d51149 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:17.898873 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fadac99c-884d-40ec-a704-6714f2d51149 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:17.905873 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fadac99c-884d-40ec-a704-6714f2d51149 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:17.906333 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fadac99c-884d-40ec-a704-6714f2d51149 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:17.907099 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fadac99c-884d-40ec-a704-6714f2d51149 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:17.907534 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fadac99c-884d-40ec-a704-6714f2d51149 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:18.038326 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cf8a6dea-d2ce-4b00-8031-c2b11d6a0795 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:18.055312 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cf8a6dea-d2ce-4b00-8031-c2b11d6a0795 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:18.055312 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cf8a6dea-d2ce-4b00-8031-c2b11d6a0795 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:18.055312 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cf8a6dea-d2ce-4b00-8031-c2b11d6a0795 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.174326 Jul 18 16:56:18.055683 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 325/646] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:17 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:18.065336 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-30f101b7-10b4-4941-8078-3c20a83c247d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:18.066240 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-30f101b7-10b4-4941-8078-3c20a83c247d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:18.073587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-30f101b7-10b4-4941-8078-3c20a83c247d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:18.074019 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-30f101b7-10b4-4941-8078-3c20a83c247d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:18.074817 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-30f101b7-10b4-4941-8078-3c20a83c247d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:18.075321 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-30f101b7-10b4-4941-8078-3c20a83c247d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:18.126421 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fadac99c-884d-40ec-a704-6714f2d51149 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:18.134081 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fadac99c-884d-40ec-a704-6714f2d51149 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.239527 Jul 18 16:56:18.134576 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 322/647] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:17 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:18.209956 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-30f101b7-10b4-4941-8078-3c20a83c247d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:18.217450 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-30f101b7-10b4-4941-8078-3c20a83c247d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.164904 Jul 18 16:56:18.218881 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 326/648] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:18 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:19.070407 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4c9484af-55a1-4c63-8f01-61e18ba6d772 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:19.071015 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4c9484af-55a1-4c63-8f01-61e18ba6d772 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:19.077735 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4c9484af-55a1-4c63-8f01-61e18ba6d772 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:19.078279 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4c9484af-55a1-4c63-8f01-61e18ba6d772 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:19.079065 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4c9484af-55a1-4c63-8f01-61e18ba6d772 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:19.079502 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4c9484af-55a1-4c63-8f01-61e18ba6d772 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:19.153389 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-949cafc5-0340-4426-95e9-be8f7f8188de tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:19.154029 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-949cafc5-0340-4426-95e9-be8f7f8188de tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:19.162163 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-949cafc5-0340-4426-95e9-be8f7f8188de tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:19.162682 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-949cafc5-0340-4426-95e9-be8f7f8188de tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:19.163461 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-949cafc5-0340-4426-95e9-be8f7f8188de tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:19.163922 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-949cafc5-0340-4426-95e9-be8f7f8188de tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:19.228240 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4c9484af-55a1-4c63-8f01-61e18ba6d772 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:19.238117 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4c9484af-55a1-4c63-8f01-61e18ba6d772 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:19.239650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4c9484af-55a1-4c63-8f01-61e18ba6d772 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:19.240823 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4c9484af-55a1-4c63-8f01-61e18ba6d772 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.174459 Jul 18 16:56:19.241415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 323/649] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:19 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:19.246103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-10a959a0-1058-4ef1-93b2-473cc4fbfaf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:19.246718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-10a959a0-1058-4ef1-93b2-473cc4fbfaf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:19.253446 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10a959a0-1058-4ef1-93b2-473cc4fbfaf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:19.253896 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10a959a0-1058-4ef1-93b2-473cc4fbfaf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:19.254669 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10a959a0-1058-4ef1-93b2-473cc4fbfaf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:19.255155 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10a959a0-1058-4ef1-93b2-473cc4fbfaf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:19.312317 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-949cafc5-0340-4426-95e9-be8f7f8188de tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:19.320174 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-949cafc5-0340-4426-95e9-be8f7f8188de tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.172425 Jul 18 16:56:19.320831 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 327/650] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:19 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:19.401271 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-10a959a0-1058-4ef1-93b2-473cc4fbfaf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:19.410626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-10a959a0-1058-4ef1-93b2-473cc4fbfaf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.167562 Jul 18 16:56:19.410626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 324/651] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:19 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:20.261165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6c2719e6-07b4-4231-bfb4-621eebddedf1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:20.261996 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6c2719e6-07b4-4231-bfb4-621eebddedf1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:20.265142 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=80 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:20.271090 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6c2719e6-07b4-4231-bfb4-621eebddedf1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:20.271672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6c2719e6-07b4-4231-bfb4-621eebddedf1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:20.272609 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6c2719e6-07b4-4231-bfb4-621eebddedf1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:20.273138 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6c2719e6-07b4-4231-bfb4-621eebddedf1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:20.338372 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-18b6d5fb-b1cc-45c1-8590-8e1735f58d29 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:20.338985 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-18b6d5fb-b1cc-45c1-8590-8e1735f58d29 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:20.346121 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-18b6d5fb-b1cc-45c1-8590-8e1735f58d29 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:20.346550 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-18b6d5fb-b1cc-45c1-8590-8e1735f58d29 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:20.347339 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-18b6d5fb-b1cc-45c1-8590-8e1735f58d29 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:20.347780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-18b6d5fb-b1cc-45c1-8590-8e1735f58d29 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:20.426548 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6c2719e6-07b4-4231-bfb4-621eebddedf1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:20.435443 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6c2719e6-07b4-4231-bfb4-621eebddedf1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:20.436988 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6c2719e6-07b4-4231-bfb4-621eebddedf1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:20.438186 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6c2719e6-07b4-4231-bfb4-621eebddedf1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.181780 Jul 18 16:56:20.438750 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 328/652] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:20 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:20.443114 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-027e7883-752a-4f7e-921a-bb3f0f235afa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:20.443966 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-027e7883-752a-4f7e-921a-bb3f0f235afa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:20.450636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-027e7883-752a-4f7e-921a-bb3f0f235afa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:20.451087 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-027e7883-752a-4f7e-921a-bb3f0f235afa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:20.452360 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-027e7883-752a-4f7e-921a-bb3f0f235afa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:20.452801 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-027e7883-752a-4f7e-921a-bb3f0f235afa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:20.495251 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-18b6d5fb-b1cc-45c1-8590-8e1735f58d29 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:20.504046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-18b6d5fb-b1cc-45c1-8590-8e1735f58d29 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.169780 Jul 18 16:56:20.504625 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 325/653] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:20 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:20.584886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-027e7883-752a-4f7e-921a-bb3f0f235afa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:20.592359 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-027e7883-752a-4f7e-921a-bb3f0f235afa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.152661 Jul 18 16:56:20.592920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 329/654] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:20 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:21.457062 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7e1998df-371c-4950-ad57-85317c47f297 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:21.457666 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7e1998df-371c-4950-ad57-85317c47f297 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:21.464058 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7e1998df-371c-4950-ad57-85317c47f297 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:21.464517 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7e1998df-371c-4950-ad57-85317c47f297 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:21.465322 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7e1998df-371c-4950-ad57-85317c47f297 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:21.465756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7e1998df-371c-4950-ad57-85317c47f297 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:21.521748 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-97a57db7-2155-426e-82c6-51941db6dd78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:21.522359 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-97a57db7-2155-426e-82c6-51941db6dd78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:21.528843 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-97a57db7-2155-426e-82c6-51941db6dd78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:21.529355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-97a57db7-2155-426e-82c6-51941db6dd78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:21.530122 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-97a57db7-2155-426e-82c6-51941db6dd78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:21.531369 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-97a57db7-2155-426e-82c6-51941db6dd78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:21.600624 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7e1998df-371c-4950-ad57-85317c47f297 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:21.609616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7e1998df-371c-4950-ad57-85317c47f297 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:21.611440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7e1998df-371c-4950-ad57-85317c47f297 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:21.612597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7e1998df-371c-4950-ad57-85317c47f297 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.160131 Jul 18 16:56:21.613689 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 326/655] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:21 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:21.617676 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-533fa2ce-e679-40d2-bdcd-8c2460d761e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:21.618286 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-533fa2ce-e679-40d2-bdcd-8c2460d761e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:21.625095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-533fa2ce-e679-40d2-bdcd-8c2460d761e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:21.625685 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-533fa2ce-e679-40d2-bdcd-8c2460d761e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:21.626374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-533fa2ce-e679-40d2-bdcd-8c2460d761e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:21.626840 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-533fa2ce-e679-40d2-bdcd-8c2460d761e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:21.671569 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-97a57db7-2155-426e-82c6-51941db6dd78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:21.679310 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-97a57db7-2155-426e-82c6-51941db6dd78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1367 microversion: 2.1 time: 0.161311 Jul 18 16:56:21.679905 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 330/656] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:21 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:21.768630 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-533fa2ce-e679-40d2-bdcd-8c2460d761e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:21.777087 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-533fa2ce-e679-40d2-bdcd-8c2460d761e6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.162759 Jul 18 16:56:21.777870 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 327/657] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:21 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:22.631026 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5495a366-de5f-4780-8e76-adb4af009355 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:22.631846 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5495a366-de5f-4780-8e76-adb4af009355 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:22.638225 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5495a366-de5f-4780-8e76-adb4af009355 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:22.638682 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5495a366-de5f-4780-8e76-adb4af009355 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.639456 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5495a366-de5f-4780-8e76-adb4af009355 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:22.639897 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5495a366-de5f-4780-8e76-adb4af009355 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.697201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-89b19f9c-591c-4d0f-9253-50b98f52de64 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:22.697809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-89b19f9c-591c-4d0f-9253-50b98f52de64 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:22.715251 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-89b19f9c-591c-4d0f-9253-50b98f52de64 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:22.717058 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-89b19f9c-591c-4d0f-9253-50b98f52de64 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.717864 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-89b19f9c-591c-4d0f-9253-50b98f52de64 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:22.718353 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-89b19f9c-591c-4d0f-9253-50b98f52de64 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.782885 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5495a366-de5f-4780-8e76-adb4af009355 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:22.792456 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5495a366-de5f-4780-8e76-adb4af009355 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:22.794337 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5495a366-de5f-4780-8e76-adb4af009355 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:22.795818 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5495a366-de5f-4780-8e76-adb4af009355 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.168734 Jul 18 16:56:22.796630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 331/658] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:22 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:22.801388 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cb146f09-ed41-43ad-baea-f505f60158c6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:22.801987 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cb146f09-ed41-43ad-baea-f505f60158c6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:22.808704 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cb146f09-ed41-43ad-baea-f505f60158c6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:22.809202 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cb146f09-ed41-43ad-baea-f505f60158c6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.810149 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cb146f09-ed41-43ad-baea-f505f60158c6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:22.810981 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cb146f09-ed41-43ad-baea-f505f60158c6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.881410 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-89b19f9c-591c-4d0f-9253-50b98f52de64 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:22.891372 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-89b19f9c-591c-4d0f-9253-50b98f52de64 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1558 microversion: 2.1 time: 0.197849 Jul 18 16:56:22.891974 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 328/659] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:22 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1558 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:22.914764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c174d267-5445-41e2-afe5-0f0f3665fd2e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:22.915261 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c174d267-5445-41e2-afe5-0f0f3665fd2e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:22.921914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c174d267-5445-41e2-afe5-0f0f3665fd2e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:22.922465 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c174d267-5445-41e2-afe5-0f0f3665fd2e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.923362 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c174d267-5445-41e2-afe5-0f0f3665fd2e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:22.923802 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c174d267-5445-41e2-afe5-0f0f3665fd2e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.956607 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cb146f09-ed41-43ad-baea-f505f60158c6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:22.958917 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:22.964942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cb146f09-ed41-43ad-baea-f505f60158c6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.167561 Jul 18 16:56:22.965551 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 332/660] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:22 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:23.009117 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c174d267-5445-41e2-afe5-0f0f3665fd2e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098172 Jul 18 16:56:23.009776 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 329/661] 10.222.0.76 () {58 vars in 1274 bytes} [Mon Jul 18 16:56:22 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:56:23.818877 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6d767a9c-19a4-493c-afcc-221972f21428 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:23.819616 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6d767a9c-19a4-493c-afcc-221972f21428 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:23.826817 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6d767a9c-19a4-493c-afcc-221972f21428 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:23.827266 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6d767a9c-19a4-493c-afcc-221972f21428 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:23.833850 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6d767a9c-19a4-493c-afcc-221972f21428 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:23.833850 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6d767a9c-19a4-493c-afcc-221972f21428 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:23.966051 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-99a62738-9ea4-4c96-8dfa-991d09f4091a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:23.973575 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-99a62738-9ea4-4c96-8dfa-991d09f4091a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:23.974276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-99a62738-9ea4-4c96-8dfa-991d09f4091a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:23.987271 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6d767a9c-19a4-493c-afcc-221972f21428 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:23.997319 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6d767a9c-19a4-493c-afcc-221972f21428 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:23.999064 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6d767a9c-19a4-493c-afcc-221972f21428 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:24.000076 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6d767a9c-19a4-493c-afcc-221972f21428 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.186107 Jul 18 16:56:24.001022 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 333/662] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:23 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:56:24.007118 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-73f02ac1-8c00-4c4e-a836-c16559876d6f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:24.007731 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-73f02ac1-8c00-4c4e-a836-c16559876d6f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:24.015682 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73f02ac1-8c00-4c4e-a836-c16559876d6f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:24.016210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73f02ac1-8c00-4c4e-a836-c16559876d6f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:24.016963 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73f02ac1-8c00-4c4e-a836-c16559876d6f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:24.017441 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73f02ac1-8c00-4c4e-a836-c16559876d6f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:24.039827 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-99a62738-9ea4-4c96-8dfa-991d09f4091a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Going to try to stop instance {{(pid=124868) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 16:56:24.161739 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-73f02ac1-8c00-4c4e-a836-c16559876d6f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:24.169759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-73f02ac1-8c00-4c4e-a836-c16559876d6f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.167599 Jul 18 16:56:24.170535 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 334/663] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:24 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:24.176044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-c77d9924-1b10-4e75-945b-e5ef77af5224 req-f314d4df-222b-4d79-b5cd-f40190e4f883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a961f74-97c0-4862-a288-ff06a9aa55e9", "tag": "ccdc3f7f-7e82-4dab-94cd-51b784a19c64"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:24.184648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c77d9924-1b10-4e75-945b-e5ef77af5224 req-f314d4df-222b-4d79-b5cd-f40190e4f883 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:24.185142 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c77d9924-1b10-4e75-945b-e5ef77af5224 req-f314d4df-222b-4d79-b5cd-f40190e4f883 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:24.198098 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-c77d9924-1b10-4e75-945b-e5ef77af5224 req-f314d4df-222b-4d79-b5cd-f40190e4f883 service nova] Creating event network-changed:ccdc3f7f-7e82-4dab-94cd-51b784a19c64 for instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 on hv-cinder-83754 Jul 18 16:56:24.204182 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-c77d9924-1b10-4e75-945b-e5ef77af5224 req-f314d4df-222b-4d79-b5cd-f40190e4f883 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031865 Jul 18 16:56:24.204801 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 335/664] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:24.328527 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-99a62738-9ea4-4c96-8dfa-991d09f4091a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "POST /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/action" status: 202 len: 0 microversion: 2.1 time: 0.366551 Jul 18 16:56:24.329190 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 330/665] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 16:56:23 2022] POST /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:56:24.338986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f8c57bf0-3075-42d9-b900-1d382f49fb20 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:24.339751 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f8c57bf0-3075-42d9-b900-1d382f49fb20 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:24.346461 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8c57bf0-3075-42d9-b900-1d382f49fb20 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:24.346928 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8c57bf0-3075-42d9-b900-1d382f49fb20 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:24.347721 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8c57bf0-3075-42d9-b900-1d382f49fb20 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:24.348159 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8c57bf0-3075-42d9-b900-1d382f49fb20 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:24.485851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f8c57bf0-3075-42d9-b900-1d382f49fb20 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:24.494053 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f8c57bf0-3075-42d9-b900-1d382f49fb20 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.159931 Jul 18 16:56:24.494634 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 336/666] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:24 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:25.021723 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fa7a807b-d1f3-4ef2-b536-1d29905cde1b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:25.022503 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fa7a807b-d1f3-4ef2-b536-1d29905cde1b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:25.028954 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa7a807b-d1f3-4ef2-b536-1d29905cde1b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:25.029567 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa7a807b-d1f3-4ef2-b536-1d29905cde1b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:25.030446 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa7a807b-d1f3-4ef2-b536-1d29905cde1b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:25.030961 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa7a807b-d1f3-4ef2-b536-1d29905cde1b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:25.170124 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fa7a807b-d1f3-4ef2-b536-1d29905cde1b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:25.180889 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fa7a807b-d1f3-4ef2-b536-1d29905cde1b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:25.181621 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fa7a807b-d1f3-4ef2-b536-1d29905cde1b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:25.182535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fa7a807b-d1f3-4ef2-b536-1d29905cde1b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.166007 Jul 18 16:56:25.183088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 331/667] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:25 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:25.187432 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a040b4e7-aff5-447e-960f-561691105456 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:25.188979 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a040b4e7-aff5-447e-960f-561691105456 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:25.195763 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a040b4e7-aff5-447e-960f-561691105456 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:25.196215 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a040b4e7-aff5-447e-960f-561691105456 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:25.196989 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a040b4e7-aff5-447e-960f-561691105456 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:25.197450 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a040b4e7-aff5-447e-960f-561691105456 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:25.331661 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a040b4e7-aff5-447e-960f-561691105456 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:25.339149 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a040b4e7-aff5-447e-960f-561691105456 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.155587 Jul 18 16:56:25.340263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 337/668] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:25 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:25.512612 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cfdceb22-599c-44f4-b938-4767db8f50f3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:25.513288 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cfdceb22-599c-44f4-b938-4767db8f50f3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:25.519592 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfdceb22-599c-44f4-b938-4767db8f50f3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:25.520049 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfdceb22-599c-44f4-b938-4767db8f50f3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:25.520828 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfdceb22-599c-44f4-b938-4767db8f50f3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:25.521298 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfdceb22-599c-44f4-b938-4767db8f50f3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:25.524177 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:25.657344 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cfdceb22-599c-44f4-b938-4767db8f50f3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:25.665362 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cfdceb22-599c-44f4-b938-4767db8f50f3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.157029 Jul 18 16:56:25.669865 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 332/669] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:25 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:26.205651 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3eb13ffa-0d7a-4c4e-8b3c-e4649da344fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:26.206201 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3eb13ffa-0d7a-4c4e-8b3c-e4649da344fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:26.212744 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3eb13ffa-0d7a-4c4e-8b3c-e4649da344fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:26.213232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3eb13ffa-0d7a-4c4e-8b3c-e4649da344fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:26.214006 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3eb13ffa-0d7a-4c4e-8b3c-e4649da344fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:26.214445 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3eb13ffa-0d7a-4c4e-8b3c-e4649da344fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:26.346165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3eb13ffa-0d7a-4c4e-8b3c-e4649da344fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:26.355709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ec487416-7b65-4b93-b1cc-fe544a596da3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:26.356237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3eb13ffa-0d7a-4c4e-8b3c-e4649da344fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:26.356347 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ec487416-7b65-4b93-b1cc-fe544a596da3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:26.357460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3eb13ffa-0d7a-4c4e-8b3c-e4649da344fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:26.358629 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3eb13ffa-0d7a-4c4e-8b3c-e4649da344fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.157689 Jul 18 16:56:26.359190 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 338/670] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:26 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:26.364444 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec487416-7b65-4b93-b1cc-fe544a596da3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:26.364914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec487416-7b65-4b93-b1cc-fe544a596da3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:26.365774 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec487416-7b65-4b93-b1cc-fe544a596da3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:26.366140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec487416-7b65-4b93-b1cc-fe544a596da3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:26.499643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ec487416-7b65-4b93-b1cc-fe544a596da3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:26.510730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ec487416-7b65-4b93-b1cc-fe544a596da3 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1358 microversion: 2.1 time: 0.158708 Jul 18 16:56:26.511334 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 333/671] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:26 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:26.687135 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-acbf7525-a1f8-40ee-af43-3cc8d652e184 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:26.688137 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-acbf7525-a1f8-40ee-af43-3cc8d652e184 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:26.696260 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-acbf7525-a1f8-40ee-af43-3cc8d652e184 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:26.696786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-acbf7525-a1f8-40ee-af43-3cc8d652e184 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:26.697683 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-acbf7525-a1f8-40ee-af43-3cc8d652e184 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:26.698188 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-acbf7525-a1f8-40ee-af43-3cc8d652e184 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:26.832242 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-acbf7525-a1f8-40ee-af43-3cc8d652e184 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:26.840142 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-acbf7525-a1f8-40ee-af43-3cc8d652e184 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.160672 Jul 18 16:56:26.840715 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 339/672] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:26 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:27.480862 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b4d6471a-4a35-4105-a013-40c35fa8d2d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:27.481494 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b4d6471a-4a35-4105-a013-40c35fa8d2d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:27.488066 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4d6471a-4a35-4105-a013-40c35fa8d2d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.488537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4d6471a-4a35-4105-a013-40c35fa8d2d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:27.489319 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4d6471a-4a35-4105-a013-40c35fa8d2d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.489756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4d6471a-4a35-4105-a013-40c35fa8d2d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:27.527542 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fa307f6f-675f-4a64-8fec-10505d4caddb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:27.528186 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fa307f6f-675f-4a64-8fec-10505d4caddb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:27.538200 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa307f6f-675f-4a64-8fec-10505d4caddb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.541261 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa307f6f-675f-4a64-8fec-10505d4caddb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:27.542268 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa307f6f-675f-4a64-8fec-10505d4caddb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.542713 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa307f6f-675f-4a64-8fec-10505d4caddb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:27.629688 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b4d6471a-4a35-4105-a013-40c35fa8d2d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:27.638521 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b4d6471a-4a35-4105-a013-40c35fa8d2d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:27.640041 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b4d6471a-4a35-4105-a013-40c35fa8d2d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:27.641223 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b4d6471a-4a35-4105-a013-40c35fa8d2d9 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.267398 Jul 18 16:56:27.641942 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 334/673] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:27 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:27.688995 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fa307f6f-675f-4a64-8fec-10505d4caddb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:27.702781 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fa307f6f-675f-4a64-8fec-10505d4caddb tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1548 microversion: 2.1 time: 0.173139 Jul 18 16:56:27.702781 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 340/674] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:27 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:27.777232 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-28b92019-4624-45da-913d-2cbba91e052e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:27.777838 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-28b92019-4624-45da-913d-2cbba91e052e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:27.784872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-28b92019-4624-45da-913d-2cbba91e052e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.785347 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-28b92019-4624-45da-913d-2cbba91e052e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:27.786122 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-28b92019-4624-45da-913d-2cbba91e052e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.786551 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-28b92019-4624-45da-913d-2cbba91e052e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:27.858125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-15fefa94-a600-43c7-b4d7-1b3a751c7ce2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:27.859032 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-15fefa94-a600-43c7-b4d7-1b3a751c7ce2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:27.872078 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-15fefa94-a600-43c7-b4d7-1b3a751c7ce2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.872886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-15fefa94-a600-43c7-b4d7-1b3a751c7ce2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:27.874319 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-15fefa94-a600-43c7-b4d7-1b3a751c7ce2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.875123 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-15fefa94-a600-43c7-b4d7-1b3a751c7ce2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:27.939984 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-28b92019-4624-45da-913d-2cbba91e052e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:27.947736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-28b92019-4624-45da-913d-2cbba91e052e tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1548 microversion: 2.1 time: 0.174345 Jul 18 16:56:27.948315 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 335/675] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:27 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1548 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:27.964343 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bb2bd21a-3643-4b34-93f8-13b24b6008fa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:27.967968 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bb2bd21a-3643-4b34-93f8-13b24b6008fa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:27.968736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bb2bd21a-3643-4b34-93f8-13b24b6008fa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Searching by: {'deleted': False, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91'} {{(pid=124868) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 16:56:27.976659 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb2bd21a-3643-4b34-93f8-13b24b6008fa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.977190 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb2bd21a-3643-4b34-93f8-13b24b6008fa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:27.978115 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb2bd21a-3643-4b34-93f8-13b24b6008fa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.978552 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb2bd21a-3643-4b34-93f8-13b24b6008fa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:28.035786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-15fefa94-a600-43c7-b4d7-1b3a751c7ce2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:28.045192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-15fefa94-a600-43c7-b4d7-1b3a751c7ce2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.190886 Jul 18 16:56:28.058507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 341/676] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:27 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:28.098616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.multi_cell_list [None req-bb2bd21a-3643-4b34-93f8-13b24b6008fa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 16:56:28.204428 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bb2bd21a-3643-4b34-93f8-13b24b6008fa tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.244238 Jul 18 16:56:28.205355 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 336/677] 10.222.0.76 () {58 vars in 1124 bytes} [Mon Jul 18 16:56:27 2022] GET /compute/v2.1/servers => generated 342 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:56:28.215623 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-35ce67f1-71ac-466d-b011-97f4a2a8c929 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:28.216241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-35ce67f1-71ac-466d-b011-97f4a2a8c929 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:28.222931 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-35ce67f1-71ac-466d-b011-97f4a2a8c929 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:28.223394 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-35ce67f1-71ac-466d-b011-97f4a2a8c929 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:28.224175 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-35ce67f1-71ac-466d-b011-97f4a2a8c929 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:28.224615 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-35ce67f1-71ac-466d-b011-97f4a2a8c929 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:28.268562 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-04a9adf6-9c61-416c-8ab9-c316311b0c3f req-b9202372-22c0-4287-bee4-ce5cf692648f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d31815-4f8c-4e76-adcb-8039b88488d0", "name": "network-vif-plugged", "status": "completed", "tag": "cbb20d80-19a9-48b1-be96-866c4a0904d4"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:28.277152 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-04a9adf6-9c61-416c-8ab9-c316311b0c3f req-b9202372-22c0-4287-bee4-ce5cf692648f service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:28.277604 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-04a9adf6-9c61-416c-8ab9-c316311b0c3f req-b9202372-22c0-4287-bee4-ce5cf692648f service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:28.290074 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-04a9adf6-9c61-416c-8ab9-c316311b0c3f req-b9202372-22c0-4287-bee4-ce5cf692648f service nova] Creating event network-vif-plugged:cbb20d80-19a9-48b1-be96-866c4a0904d4 for instance c3d31815-4f8c-4e76-adcb-8039b88488d0 on hv-cinder-83754 Jul 18 16:56:28.295590 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-04a9adf6-9c61-416c-8ab9-c316311b0c3f req-b9202372-22c0-4287-bee4-ce5cf692648f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031050 Jul 18 16:56:28.297089 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 337/678] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:28.371691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-35ce67f1-71ac-466d-b011-97f4a2a8c929 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:28.379893 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-35ce67f1-71ac-466d-b011-97f4a2a8c929 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1548 microversion: 2.1 time: 0.168032 Jul 18 16:56:28.380762 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 342/679] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:28 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:28.661829 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9d6db79c-8709-433d-bfc1-21a3d62c3b24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:28.662561 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9d6db79c-8709-433d-bfc1-21a3d62c3b24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:28.669196 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d6db79c-8709-433d-bfc1-21a3d62c3b24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:28.669652 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d6db79c-8709-433d-bfc1-21a3d62c3b24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:28.670431 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d6db79c-8709-433d-bfc1-21a3d62c3b24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:28.670871 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d6db79c-8709-433d-bfc1-21a3d62c3b24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:28.824537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9d6db79c-8709-433d-bfc1-21a3d62c3b24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:28.833940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9d6db79c-8709-433d-bfc1-21a3d62c3b24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:28.835438 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9d6db79c-8709-433d-bfc1-21a3d62c3b24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:28.836624 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9d6db79c-8709-433d-bfc1-21a3d62c3b24 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.179956 Jul 18 16:56:28.837229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 338/680] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:28 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:29.067912 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4fcf92b1-dc92-44bf-aef1-32e5078671a4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:29.068927 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4fcf92b1-dc92-44bf-aef1-32e5078671a4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:29.077176 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4fcf92b1-dc92-44bf-aef1-32e5078671a4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:29.078047 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4fcf92b1-dc92-44bf-aef1-32e5078671a4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:29.078900 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4fcf92b1-dc92-44bf-aef1-32e5078671a4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:29.079350 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4fcf92b1-dc92-44bf-aef1-32e5078671a4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:29.270627 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4fcf92b1-dc92-44bf-aef1-32e5078671a4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:29.281122 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4fcf92b1-dc92-44bf-aef1-32e5078671a4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.218993 Jul 18 16:56:29.282103 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 343/681] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:29 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:29.854486 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d8e347d4-4365-49fa-86aa-edba2066296f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:29.855098 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d8e347d4-4365-49fa-86aa-edba2066296f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:29.862821 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8e347d4-4365-49fa-86aa-edba2066296f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:29.863261 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8e347d4-4365-49fa-86aa-edba2066296f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:29.864023 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8e347d4-4365-49fa-86aa-edba2066296f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:29.864454 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8e347d4-4365-49fa-86aa-edba2066296f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:30.003823 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d8e347d4-4365-49fa-86aa-edba2066296f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:30.012444 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d8e347d4-4365-49fa-86aa-edba2066296f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:30.013966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d8e347d4-4365-49fa-86aa-edba2066296f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:30.015154 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d8e347d4-4365-49fa-86aa-edba2066296f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.164591 Jul 18 16:56:30.015742 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 339/682] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:29 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:30.308195 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3a8b1c89-c170-4362-808a-40743d1669eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:30.308803 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3a8b1c89-c170-4362-808a-40743d1669eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:30.317102 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a8b1c89-c170-4362-808a-40743d1669eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:30.317555 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a8b1c89-c170-4362-808a-40743d1669eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:30.318324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a8b1c89-c170-4362-808a-40743d1669eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:30.318778 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a8b1c89-c170-4362-808a-40743d1669eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:30.469714 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3a8b1c89-c170-4362-808a-40743d1669eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:30.478021 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3a8b1c89-c170-4362-808a-40743d1669eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.173663 Jul 18 16:56:30.478607 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 344/683] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:30 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:30.568740 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-96c3e1bb-903b-4107-9783-6e4642df71cc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b925ab20-5c59-4b2d-9819-65db70036e52"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:30.569834 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-96c3e1bb-903b-4107-9783-6e4642df71cc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:30.576366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96c3e1bb-903b-4107-9783-6e4642df71cc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:30.576809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96c3e1bb-903b-4107-9783-6e4642df71cc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:30.577592 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96c3e1bb-903b-4107-9783-6e4642df71cc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:30.578022 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96c3e1bb-903b-4107-9783-6e4642df71cc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.034834 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-89bc986d-e59a-4bcd-9166-c607137fdd23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:31.035815 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-89bc986d-e59a-4bcd-9166-c607137fdd23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:31.044723 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89bc986d-e59a-4bcd-9166-c607137fdd23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.045492 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89bc986d-e59a-4bcd-9166-c607137fdd23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.046313 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89bc986d-e59a-4bcd-9166-c607137fdd23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.046751 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89bc986d-e59a-4bcd-9166-c607137fdd23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.196370 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-89bc986d-e59a-4bcd-9166-c607137fdd23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:31.206693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-89bc986d-e59a-4bcd-9166-c607137fdd23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:31.208261 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-89bc986d-e59a-4bcd-9166-c607137fdd23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:31.209459 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-89bc986d-e59a-4bcd-9166-c607137fdd23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.179067 Jul 18 16:56:31.210131 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 345/684] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:31 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:56:31.471776 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a8a610c3-002f-40ee-9fe3-01294337dcf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cf3ebc1-8884-4986-be04-6cf49612b7c3"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:31.472939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a8a610c3-002f-40ee-9fe3-01294337dcf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:31.479487 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a8a610c3-002f-40ee-9fe3-01294337dcf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.479935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a8a610c3-002f-40ee-9fe3-01294337dcf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.480692 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a8a610c3-002f-40ee-9fe3-01294337dcf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.481149 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a8a610c3-002f-40ee-9fe3-01294337dcf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.971315 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-96c3e1bb-903b-4107-9783-6e4642df71cc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "POST /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.406989 Jul 18 16:56:31.971966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 340/685] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 16:56:30 2022] POST /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments => generated 194 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:31.977307 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4b4456bc-1154-4bbe-8a11-eb1309b87fa8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:31.978010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4b4456bc-1154-4bbe-8a11-eb1309b87fa8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:31.984916 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b4456bc-1154-4bbe-8a11-eb1309b87fa8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.984916 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b4456bc-1154-4bbe-8a11-eb1309b87fa8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.986030 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b4456bc-1154-4bbe-8a11-eb1309b87fa8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.986460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b4456bc-1154-4bbe-8a11-eb1309b87fa8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4b4456bc-1154-4bbe-8a11-eb1309b87fa8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:32.140577 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4b4456bc-1154-4bbe-8a11-eb1309b87fa8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.167406 Jul 18 16:56:32.141334 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 341/686] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:31 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:32.228556 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-47df3b37-d763-4dba-97dc-c47cfb74a798 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:32.229183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-47df3b37-d763-4dba-97dc-c47cfb74a798 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:32.235643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-47df3b37-d763-4dba-97dc-c47cfb74a798 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:32.236106 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-47df3b37-d763-4dba-97dc-c47cfb74a798 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.236847 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-47df3b37-d763-4dba-97dc-c47cfb74a798 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:32.237407 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-47df3b37-d763-4dba-97dc-c47cfb74a798 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.446298 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a8a610c3-002f-40ee-9fe3-01294337dcf5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "POST /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.978890 Jul 18 16:56:32.447094 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 346/687] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 16:56:31 2022] POST /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/os-volume_attachments => generated 194 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:56:32.628956 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-47df3b37-d763-4dba-97dc-c47cfb74a798 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:32.637573 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-47df3b37-d763-4dba-97dc-c47cfb74a798 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:32.639073 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-47df3b37-d763-4dba-97dc-c47cfb74a798 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:32.640222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-47df3b37-d763-4dba-97dc-c47cfb74a798 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.415555 Jul 18 16:56:32.640930 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 342/688] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:32 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:56:33.160677 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-693fb0f3-ed15-48f9-9e39-92814126b56f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:33.161403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-693fb0f3-ed15-48f9-9e39-92814126b56f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:33.167844 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-693fb0f3-ed15-48f9-9e39-92814126b56f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:33.168364 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-693fb0f3-ed15-48f9-9e39-92814126b56f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:33.169189 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-693fb0f3-ed15-48f9-9e39-92814126b56f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:33.169627 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-693fb0f3-ed15-48f9-9e39-92814126b56f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:33.313131 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-693fb0f3-ed15-48f9-9e39-92814126b56f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:33.321378 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-693fb0f3-ed15-48f9-9e39-92814126b56f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.166347 Jul 18 16:56:33.322165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 347/689] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:33 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:33.658739 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e70b5fa1-e923-4dd5-b353-f21aade1dcf2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:33.659285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e70b5fa1-e923-4dd5-b353-f21aade1dcf2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:33.665816 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e70b5fa1-e923-4dd5-b353-f21aade1dcf2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:33.666267 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e70b5fa1-e923-4dd5-b353-f21aade1dcf2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:33.667040 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e70b5fa1-e923-4dd5-b353-f21aade1dcf2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:33.667485 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e70b5fa1-e923-4dd5-b353-f21aade1dcf2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:33.808643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e70b5fa1-e923-4dd5-b353-f21aade1dcf2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:33.817930 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e70b5fa1-e923-4dd5-b353-f21aade1dcf2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:33.819783 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e70b5fa1-e923-4dd5-b353-f21aade1dcf2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:33.820603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e70b5fa1-e923-4dd5-b353-f21aade1dcf2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.166032 Jul 18 16:56:33.822108 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 343/690] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:33 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:34.339744 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2b4dfaed-4b39-4550-bc1f-4b9e364db49b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:34.340256 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2b4dfaed-4b39-4550-bc1f-4b9e364db49b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:34.347589 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b4dfaed-4b39-4550-bc1f-4b9e364db49b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:34.348045 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b4dfaed-4b39-4550-bc1f-4b9e364db49b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:34.348824 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b4dfaed-4b39-4550-bc1f-4b9e364db49b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:34.349290 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b4dfaed-4b39-4550-bc1f-4b9e364db49b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:34.481341 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2b4dfaed-4b39-4550-bc1f-4b9e364db49b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:34.483649 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:34.491583 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2b4dfaed-4b39-4550-bc1f-4b9e364db49b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.155706 Jul 18 16:56:34.492174 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 348/691] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:34 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:34.840232 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-81b955e4-0312-4ac6-bbc7-0524aeafbed2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:34.840958 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-81b955e4-0312-4ac6-bbc7-0524aeafbed2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:34.848231 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-81b955e4-0312-4ac6-bbc7-0524aeafbed2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:34.848603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-81b955e4-0312-4ac6-bbc7-0524aeafbed2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:34.849441 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-81b955e4-0312-4ac6-bbc7-0524aeafbed2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:34.849880 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-81b955e4-0312-4ac6-bbc7-0524aeafbed2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:34.984286 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-81b955e4-0312-4ac6-bbc7-0524aeafbed2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:34.993109 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-81b955e4-0312-4ac6-bbc7-0524aeafbed2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:34.994603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-81b955e4-0312-4ac6-bbc7-0524aeafbed2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:34.995747 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-81b955e4-0312-4ac6-bbc7-0524aeafbed2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.159542 Jul 18 16:56:34.996346 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 344/692] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:34 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:35.515513 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-de446efe-0618-43e1-901f-cc9f8201ff72 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:35.516152 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-de446efe-0618-43e1-901f-cc9f8201ff72 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:35.525202 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-de446efe-0618-43e1-901f-cc9f8201ff72 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:35.525202 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-de446efe-0618-43e1-901f-cc9f8201ff72 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:35.525202 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-de446efe-0618-43e1-901f-cc9f8201ff72 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:35.525713 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-de446efe-0618-43e1-901f-cc9f8201ff72 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:35.692181 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-de446efe-0618-43e1-901f-cc9f8201ff72 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:35.700878 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-de446efe-0618-43e1-901f-cc9f8201ff72 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.189141 Jul 18 16:56:35.701656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 349/693] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:35 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:36.014695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1ca125c9-2e46-4630-89e8-86fa3fc18510 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:36.015980 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1ca125c9-2e46-4630-89e8-86fa3fc18510 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:36.018677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=80 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:36.023647 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1ca125c9-2e46-4630-89e8-86fa3fc18510 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:36.024097 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1ca125c9-2e46-4630-89e8-86fa3fc18510 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:36.024866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1ca125c9-2e46-4630-89e8-86fa3fc18510 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:36.025365 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1ca125c9-2e46-4630-89e8-86fa3fc18510 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:36.169166 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1ca125c9-2e46-4630-89e8-86fa3fc18510 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:36.178787 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1ca125c9-2e46-4630-89e8-86fa3fc18510 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:36.180382 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1ca125c9-2e46-4630-89e8-86fa3fc18510 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:36.181469 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1ca125c9-2e46-4630-89e8-86fa3fc18510 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1810 microversion: 2.20 time: 0.170667 Jul 18 16:56:36.182030 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 345/694] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:36 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:36.727999 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e0479d7b-22d1-4886-a048-1b9d59a40da3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:36.727999 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e0479d7b-22d1-4886-a048-1b9d59a40da3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:36.727999 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e0479d7b-22d1-4886-a048-1b9d59a40da3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:36.727999 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e0479d7b-22d1-4886-a048-1b9d59a40da3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:36.728636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e0479d7b-22d1-4886-a048-1b9d59a40da3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:36.728636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e0479d7b-22d1-4886-a048-1b9d59a40da3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:36.870752 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e0479d7b-22d1-4886-a048-1b9d59a40da3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:36.880471 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e0479d7b-22d1-4886-a048-1b9d59a40da3 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.166841 Jul 18 16:56:36.881078 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 350/695] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:36 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:37.200730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a59e2aa8-5596-4bff-a7fe-938728815022 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:37.201368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a59e2aa8-5596-4bff-a7fe-938728815022 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:37.209357 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a59e2aa8-5596-4bff-a7fe-938728815022 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.209831 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a59e2aa8-5596-4bff-a7fe-938728815022 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.210603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a59e2aa8-5596-4bff-a7fe-938728815022 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.211040 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a59e2aa8-5596-4bff-a7fe-938728815022 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.358760 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a59e2aa8-5596-4bff-a7fe-938728815022 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:37.367531 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a59e2aa8-5596-4bff-a7fe-938728815022 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:37.369053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a59e2aa8-5596-4bff-a7fe-938728815022 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:37.370242 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a59e2aa8-5596-4bff-a7fe-938728815022 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1797 microversion: 2.20 time: 0.174134 Jul 18 16:56:37.370984 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 346/696] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:37 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1797 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:37.897822 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8167b920-8076-4149-8318-c4cd711b404f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:37.898361 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8167b920-8076-4149-8318-c4cd711b404f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:37.904887 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8167b920-8076-4149-8318-c4cd711b404f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.905367 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8167b920-8076-4149-8318-c4cd711b404f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.906131 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8167b920-8076-4149-8318-c4cd711b404f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.906570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8167b920-8076-4149-8318-c4cd711b404f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:38.050390 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8167b920-8076-4149-8318-c4cd711b404f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:38.059448 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8167b920-8076-4149-8318-c4cd711b404f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.165518 Jul 18 16:56:38.066775 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 351/697] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:37 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:39.076871 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-08790e9b-a20a-4de2-8a1d-028a99b4edda tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:39.077514 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-08790e9b-a20a-4de2-8a1d-028a99b4edda tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:39.080220 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:39.085826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-08790e9b-a20a-4de2-8a1d-028a99b4edda tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:39.086285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-08790e9b-a20a-4de2-8a1d-028a99b4edda tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:39.087064 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-08790e9b-a20a-4de2-8a1d-028a99b4edda tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:39.087504 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-08790e9b-a20a-4de2-8a1d-028a99b4edda tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:39.224713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-08790e9b-a20a-4de2-8a1d-028a99b4edda tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:39.227085 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:39.234512 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-08790e9b-a20a-4de2-8a1d-028a99b4edda tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.161411 Jul 18 16:56:39.235089 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 347/698] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:39 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:40.253804 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c39a8f61-d391-430b-878d-c6984d60f2ab tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:40.254539 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c39a8f61-d391-430b-878d-c6984d60f2ab tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:40.261166 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c39a8f61-d391-430b-878d-c6984d60f2ab tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.261612 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c39a8f61-d391-430b-878d-c6984d60f2ab tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.262381 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c39a8f61-d391-430b-878d-c6984d60f2ab tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.262815 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c39a8f61-d391-430b-878d-c6984d60f2ab tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.400550 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c39a8f61-d391-430b-878d-c6984d60f2ab tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:40.408983 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c39a8f61-d391-430b-878d-c6984d60f2ab tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.159791 Jul 18 16:56:40.409590 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 352/699] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:40 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:40.846335 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-27845b9d-5221-4860-8aea-e80318de77a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:40.847336 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-27845b9d-5221-4860-8aea-e80318de77a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:40.855337 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27845b9d-5221-4860-8aea-e80318de77a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.855785 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27845b9d-5221-4860-8aea-e80318de77a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.856552 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27845b9d-5221-4860-8aea-e80318de77a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.856984 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27845b9d-5221-4860-8aea-e80318de77a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.883101 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-27845b9d-5221-4860-8aea-e80318de77a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lazy-loading 'flavor' on Instance uuid 10246df8-f808-47a9-947f-af78a2fd64c9 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:56:41.314196 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-27845b9d-5221-4860-8aea-e80318de77a1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "POST /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/action" status: 200 len: 32 microversion: 2.1 time: 0.472082 Jul 18 16:56:41.314815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 348/700] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 16:56:40 2022] POST /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/action => generated 32 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:56:41.323944 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-04130de8-5caf-430f-bff6-4a0efd59c8de tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:41.324578 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-04130de8-5caf-430f-bff6-4a0efd59c8de tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:41.333241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04130de8-5caf-430f-bff6-4a0efd59c8de tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:41.333733 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04130de8-5caf-430f-bff6-4a0efd59c8de tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:41.334503 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04130de8-5caf-430f-bff6-4a0efd59c8de tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:41.334937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04130de8-5caf-430f-bff6-4a0efd59c8de tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:41.432424 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e3a9dc66-9db1-4aa4-ba64-f8b912c2c9ee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:41.433204 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e3a9dc66-9db1-4aa4-ba64-f8b912c2c9ee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:41.439619 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e3a9dc66-9db1-4aa4-ba64-f8b912c2c9ee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:41.440151 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e3a9dc66-9db1-4aa4-ba64-f8b912c2c9ee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:41.440983 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e3a9dc66-9db1-4aa4-ba64-f8b912c2c9ee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:41.441543 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e3a9dc66-9db1-4aa4-ba64-f8b912c2c9ee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:41.476144 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-04130de8-5caf-430f-bff6-4a0efd59c8de tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:41.485343 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-04130de8-5caf-430f-bff6-4a0efd59c8de tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.165127 Jul 18 16:56:41.486753 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 353/701] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:41 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:41.588524 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e3a9dc66-9db1-4aa4-ba64-f8b912c2c9ee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:41.598728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e3a9dc66-9db1-4aa4-ba64-f8b912c2c9ee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.170838 Jul 18 16:56:41.599397 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 349/702] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:41 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:42.510219 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b82fd76e-d5f8-4491-8697-7a31404d6d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:42.510736 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b82fd76e-d5f8-4491-8697-7a31404d6d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:42.517415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b82fd76e-d5f8-4491-8697-7a31404d6d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:42.522329 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b82fd76e-d5f8-4491-8697-7a31404d6d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:42.522329 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b82fd76e-d5f8-4491-8697-7a31404d6d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:42.522329 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b82fd76e-d5f8-4491-8697-7a31404d6d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:42.616899 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1a18ffbd-f348-4137-ace2-6c8d82fd1217 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:42.631412 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1a18ffbd-f348-4137-ace2-6c8d82fd1217 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:42.631412 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1a18ffbd-f348-4137-ace2-6c8d82fd1217 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:42.631412 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1a18ffbd-f348-4137-ace2-6c8d82fd1217 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:42.631412 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1a18ffbd-f348-4137-ace2-6c8d82fd1217 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:42.631806 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1a18ffbd-f348-4137-ace2-6c8d82fd1217 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:42.658666 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b82fd76e-d5f8-4491-8697-7a31404d6d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:42.667231 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b82fd76e-d5f8-4491-8697-7a31404d6d6f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.160875 Jul 18 16:56:42.667808 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 354/703] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:42 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:42.767917 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1a18ffbd-f348-4137-ace2-6c8d82fd1217 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:42.776267 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1a18ffbd-f348-4137-ace2-6c8d82fd1217 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.163216 Jul 18 16:56:42.777604 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 350/704] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:42 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:43.685243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4f6a03db-8ec3-427a-8c96-3970f8bb67fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:43.685808 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4f6a03db-8ec3-427a-8c96-3970f8bb67fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:43.693090 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f6a03db-8ec3-427a-8c96-3970f8bb67fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.693550 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f6a03db-8ec3-427a-8c96-3970f8bb67fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.694328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f6a03db-8ec3-427a-8c96-3970f8bb67fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.694770 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f6a03db-8ec3-427a-8c96-3970f8bb67fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.796355 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-515a0fc8-0f67-4f97-8a73-021a0c9751bb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:43.796955 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-515a0fc8-0f67-4f97-8a73-021a0c9751bb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:43.804103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-515a0fc8-0f67-4f97-8a73-021a0c9751bb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.804554 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-515a0fc8-0f67-4f97-8a73-021a0c9751bb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.805360 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-515a0fc8-0f67-4f97-8a73-021a0c9751bb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.805794 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-515a0fc8-0f67-4f97-8a73-021a0c9751bb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.827895 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4f6a03db-8ec3-427a-8c96-3970f8bb67fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:43.836409 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4f6a03db-8ec3-427a-8c96-3970f8bb67fe tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.155046 Jul 18 16:56:43.836994 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 355/705] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:43 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:43.939677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-515a0fc8-0f67-4f97-8a73-021a0c9751bb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:43.948020 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-515a0fc8-0f67-4f97-8a73-021a0c9751bb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.155443 Jul 18 16:56:43.948597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 351/706] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:43 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:44.854144 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-55e2a78c-ff85-40cc-9186-0dfd4c9d7534 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:44.854777 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-55e2a78c-ff85-40cc-9186-0dfd4c9d7534 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:44.861717 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-55e2a78c-ff85-40cc-9186-0dfd4c9d7534 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.862169 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-55e2a78c-ff85-40cc-9186-0dfd4c9d7534 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.862939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-55e2a78c-ff85-40cc-9186-0dfd4c9d7534 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.863384 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-55e2a78c-ff85-40cc-9186-0dfd4c9d7534 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.965796 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4a33e940-7b06-4ab6-8fd3-f22e5b89dc4f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:44.966418 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4a33e940-7b06-4ab6-8fd3-f22e5b89dc4f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:44.973038 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4a33e940-7b06-4ab6-8fd3-f22e5b89dc4f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.973495 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4a33e940-7b06-4ab6-8fd3-f22e5b89dc4f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.974256 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4a33e940-7b06-4ab6-8fd3-f22e5b89dc4f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.974693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4a33e940-7b06-4ab6-8fd3-f22e5b89dc4f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.997421 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-55e2a78c-ff85-40cc-9186-0dfd4c9d7534 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:45.006538 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-55e2a78c-ff85-40cc-9186-0dfd4c9d7534 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.156231 Jul 18 16:56:45.007130 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 356/707] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:44 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:45.112875 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4a33e940-7b06-4ab6-8fd3-f22e5b89dc4f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:45.121191 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4a33e940-7b06-4ab6-8fd3-f22e5b89dc4f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.159245 Jul 18 16:56:45.121768 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 352/708] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:44 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:46.023806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6a6f9349-6ab1-49eb-97f1-55f1f57a3e17 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:46.024436 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6a6f9349-6ab1-49eb-97f1-55f1f57a3e17 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:46.031180 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a6f9349-6ab1-49eb-97f1-55f1f57a3e17 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:46.031632 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a6f9349-6ab1-49eb-97f1-55f1f57a3e17 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:46.032454 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a6f9349-6ab1-49eb-97f1-55f1f57a3e17 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:46.033108 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a6f9349-6ab1-49eb-97f1-55f1f57a3e17 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:46.139535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-df41bb9a-2329-495d-90f2-b413b85821f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:46.140270 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-df41bb9a-2329-495d-90f2-b413b85821f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:46.148939 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df41bb9a-2329-495d-90f2-b413b85821f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:46.149741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df41bb9a-2329-495d-90f2-b413b85821f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:46.150783 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df41bb9a-2329-495d-90f2-b413b85821f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:46.151393 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df41bb9a-2329-495d-90f2-b413b85821f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:46.176298 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6a6f9349-6ab1-49eb-97f1-55f1f57a3e17 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:46.193072 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6a6f9349-6ab1-49eb-97f1-55f1f57a3e17 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.172471 Jul 18 16:56:46.194604 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 357/709] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:46 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:46.297689 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-df41bb9a-2329-495d-90f2-b413b85821f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:46.306893 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-df41bb9a-2329-495d-90f2-b413b85821f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1723 microversion: 2.1 time: 0.171328 Jul 18 16:56:46.307461 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 353/710] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:46 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:47.211851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-da6fb0c8-0a3d-487f-ab4e-492b8469d06d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:47.212460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-da6fb0c8-0a3d-487f-ab4e-492b8469d06d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:47.218993 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-da6fb0c8-0a3d-487f-ab4e-492b8469d06d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:47.219445 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-da6fb0c8-0a3d-487f-ab4e-492b8469d06d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:47.220275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-da6fb0c8-0a3d-487f-ab4e-492b8469d06d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:47.220729 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-da6fb0c8-0a3d-487f-ab4e-492b8469d06d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:47.323790 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cedbab3b-cf3d-4603-8d45-002b4c69e3e1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:47.324764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cedbab3b-cf3d-4603-8d45-002b4c69e3e1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:47.332186 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cedbab3b-cf3d-4603-8d45-002b4c69e3e1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:47.332752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cedbab3b-cf3d-4603-8d45-002b4c69e3e1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:47.333774 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cedbab3b-cf3d-4603-8d45-002b4c69e3e1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:47.334212 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cedbab3b-cf3d-4603-8d45-002b4c69e3e1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:47.359932 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-da6fb0c8-0a3d-487f-ab4e-492b8469d06d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:47.375544 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-da6fb0c8-0a3d-487f-ab4e-492b8469d06d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.167165 Jul 18 16:56:47.381556 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 358/711] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:47 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:47.472115 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cedbab3b-cf3d-4603-8d45-002b4c69e3e1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:47.480139 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cedbab3b-cf3d-4603-8d45-002b4c69e3e1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1700 microversion: 2.1 time: 0.160167 Jul 18 16:56:47.480714 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 354/712] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:47 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1700 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:47.498136 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b31c9b01-0dbd-4f4e-9ad8-2067d15b4b59 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:47.505218 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b31c9b01-0dbd-4f4e-9ad8-2067d15b4b59 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:47.505669 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b31c9b01-0dbd-4f4e-9ad8-2067d15b4b59 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:47.566136 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b31c9b01-0dbd-4f4e-9ad8-2067d15b4b59 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Going to try to start instance {{(pid=124867) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 16:56:47.788074 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b31c9b01-0dbd-4f4e-9ad8-2067d15b4b59 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "POST /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/action" status: 202 len: 0 microversion: 2.1 time: 0.293444 Jul 18 16:56:47.788790 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 359/713] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 16:56:47 2022] POST /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:56:47.796995 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8706c410-d0ec-4fca-9cfb-e145d2556b3b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:47.803380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8706c410-d0ec-4fca-9cfb-e145d2556b3b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:47.804602 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8706c410-d0ec-4fca-9cfb-e145d2556b3b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:47.805071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8706c410-d0ec-4fca-9cfb-e145d2556b3b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:47.805842 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8706c410-d0ec-4fca-9cfb-e145d2556b3b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:47.806268 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8706c410-d0ec-4fca-9cfb-e145d2556b3b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:47.940278 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8706c410-d0ec-4fca-9cfb-e145d2556b3b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:47.948328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8706c410-d0ec-4fca-9cfb-e145d2556b3b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1709 microversion: 2.1 time: 0.155210 Jul 18 16:56:47.948891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 355/714] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:47 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1709 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:48.396130 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c492a8ef-9493-4cd8-8d21-ba88a768d8a3 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:48.396860 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c492a8ef-9493-4cd8-8d21-ba88a768d8a3 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:48.403099 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c492a8ef-9493-4cd8-8d21-ba88a768d8a3 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:48.403572 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c492a8ef-9493-4cd8-8d21-ba88a768d8a3 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:48.404326 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c492a8ef-9493-4cd8-8d21-ba88a768d8a3 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:48.404762 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c492a8ef-9493-4cd8-8d21-ba88a768d8a3 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:48.538658 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c492a8ef-9493-4cd8-8d21-ba88a768d8a3 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:48.546852 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c492a8ef-9493-4cd8-8d21-ba88a768d8a3 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.155928 Jul 18 16:56:48.552804 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 360/715] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:48 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:48.966241 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9853dfca-bb30-474d-a5ff-ab221f734d6a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:48.967614 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9853dfca-bb30-474d-a5ff-ab221f734d6a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:48.976393 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9853dfca-bb30-474d-a5ff-ab221f734d6a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:48.976850 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9853dfca-bb30-474d-a5ff-ab221f734d6a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:48.977662 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9853dfca-bb30-474d-a5ff-ab221f734d6a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:48.978375 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9853dfca-bb30-474d-a5ff-ab221f734d6a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:49.194174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9853dfca-bb30-474d-a5ff-ab221f734d6a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:49.202294 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9853dfca-bb30-474d-a5ff-ab221f734d6a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1709 microversion: 2.1 time: 0.240383 Jul 18 16:56:49.202863 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 356/716] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:48 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1709 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:49.519172 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-26ddbd2f-9409-4728-90b1-4cebc6934eb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:49.520021 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-26ddbd2f-9409-4728-90b1-4cebc6934eb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:49.528798 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-26ddbd2f-9409-4728-90b1-4cebc6934eb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:49.529277 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-26ddbd2f-9409-4728-90b1-4cebc6934eb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:49.530044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-26ddbd2f-9409-4728-90b1-4cebc6934eb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:49.530502 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-26ddbd2f-9409-4728-90b1-4cebc6934eb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:49.567683 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0ebe85d7-32c1-4462-95d8-8c4d227dc72a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:49.568386 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0ebe85d7-32c1-4462-95d8-8c4d227dc72a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:49.574663 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0ebe85d7-32c1-4462-95d8-8c4d227dc72a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:49.575117 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0ebe85d7-32c1-4462-95d8-8c4d227dc72a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:49.575919 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0ebe85d7-32c1-4462-95d8-8c4d227dc72a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:49.576359 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0ebe85d7-32c1-4462-95d8-8c4d227dc72a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:49.678942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-26ddbd2f-9409-4728-90b1-4cebc6934eb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:49.687170 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-26ddbd2f-9409-4728-90b1-4cebc6934eb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1594 microversion: 2.1 time: 0.172286 Jul 18 16:56:49.687744 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 361/717] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:49 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1594 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:49.730312 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0ebe85d7-32c1-4462-95d8-8c4d227dc72a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:49.741724 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0ebe85d7-32c1-4462-95d8-8c4d227dc72a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.177869 Jul 18 16:56:49.742885 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 357/718] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:49 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:50.220306 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d7dea065-b6cc-4685-a8a6-619011e1a930 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:50.220827 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d7dea065-b6cc-4685-a8a6-619011e1a930 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:50.227220 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7dea065-b6cc-4685-a8a6-619011e1a930 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:50.227668 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7dea065-b6cc-4685-a8a6-619011e1a930 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:50.228430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7dea065-b6cc-4685-a8a6-619011e1a930 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:50.228871 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7dea065-b6cc-4685-a8a6-619011e1a930 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:50.380656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d7dea065-b6cc-4685-a8a6-619011e1a930 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:50.388782 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d7dea065-b6cc-4685-a8a6-619011e1a930 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1709 microversion: 2.1 time: 0.172650 Jul 18 16:56:50.389397 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 362/719] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:50 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1709 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:50.761728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3dd17d52-91d2-4f51-b2b8-9f9ae8a92682 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:50.767557 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3dd17d52-91d2-4f51-b2b8-9f9ae8a92682 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:50.768749 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3dd17d52-91d2-4f51-b2b8-9f9ae8a92682 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:50.769232 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3dd17d52-91d2-4f51-b2b8-9f9ae8a92682 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:50.770078 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3dd17d52-91d2-4f51-b2b8-9f9ae8a92682 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:50.770517 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3dd17d52-91d2-4f51-b2b8-9f9ae8a92682 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:50.909349 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3dd17d52-91d2-4f51-b2b8-9f9ae8a92682 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:50.917649 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3dd17d52-91d2-4f51-b2b8-9f9ae8a92682 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.161658 Jul 18 16:56:50.918271 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 358/720] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:50 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:51.406642 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b048ebe7-a48a-4b49-8365-0b633dc81bdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:51.407612 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b048ebe7-a48a-4b49-8365-0b633dc81bdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:51.410834 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=70 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:51.416014 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b048ebe7-a48a-4b49-8365-0b633dc81bdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:51.416546 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b048ebe7-a48a-4b49-8365-0b633dc81bdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:51.417445 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b048ebe7-a48a-4b49-8365-0b633dc81bdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:51.418043 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b048ebe7-a48a-4b49-8365-0b633dc81bdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:51.671855 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b048ebe7-a48a-4b49-8365-0b633dc81bdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:51.681046 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b048ebe7-a48a-4b49-8365-0b633dc81bdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1709 microversion: 2.1 time: 0.278370 Jul 18 16:56:51.681687 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 363/721] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:51 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1709 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:51.937367 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0b2511ba-b8ef-4c3d-ae6f-2d875a8629af tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:51.937911 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0b2511ba-b8ef-4c3d-ae6f-2d875a8629af tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:51.944949 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b2511ba-b8ef-4c3d-ae6f-2d875a8629af tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:51.945477 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b2511ba-b8ef-4c3d-ae6f-2d875a8629af tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:51.946197 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b2511ba-b8ef-4c3d-ae6f-2d875a8629af tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:51.946632 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b2511ba-b8ef-4c3d-ae6f-2d875a8629af tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:52.084340 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0b2511ba-b8ef-4c3d-ae6f-2d875a8629af tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:52.093042 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0b2511ba-b8ef-4c3d-ae6f-2d875a8629af tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.159585 Jul 18 16:56:52.093663 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 359/722] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:51 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:52.225142 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-8b341ce5-c6c5-4a97-a9d5-239bc4c4bed3 req-326a6df5-00d4-48f7-b7a0-03f74626172f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb84650-2a5a-491b-a7fd-2b80fc1b8c57", "tag": "ffbf241e-13b6-4507-9161-8a88eafc095a"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:52.247017 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-8b341ce5-c6c5-4a97-a9d5-239bc4c4bed3 req-326a6df5-00d4-48f7-b7a0-03f74626172f service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:52.247471 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-8b341ce5-c6c5-4a97-a9d5-239bc4c4bed3 req-326a6df5-00d4-48f7-b7a0-03f74626172f service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:52.259240 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-8b341ce5-c6c5-4a97-a9d5-239bc4c4bed3 req-326a6df5-00d4-48f7-b7a0-03f74626172f service nova] Creating event network-changed:ffbf241e-13b6-4507-9161-8a88eafc095a for instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 on hv-cinder-83754 Jul 18 16:56:52.264158 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-8b341ce5-c6c5-4a97-a9d5-239bc4c4bed3 req-326a6df5-00d4-48f7-b7a0-03f74626172f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119161 Jul 18 16:56:52.264758 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 364/723] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:52.698988 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4880476f-b1e4-41ff-a65d-b0a715b55401 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:52.699607 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4880476f-b1e4-41ff-a65d-b0a715b55401 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:52.707477 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4880476f-b1e4-41ff-a65d-b0a715b55401 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:52.707932 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4880476f-b1e4-41ff-a65d-b0a715b55401 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:52.708713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4880476f-b1e4-41ff-a65d-b0a715b55401 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:52.709185 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4880476f-b1e4-41ff-a65d-b0a715b55401 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:52.993429 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4880476f-b1e4-41ff-a65d-b0a715b55401 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:53.003565 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4880476f-b1e4-41ff-a65d-b0a715b55401 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1713 microversion: 2.1 time: 0.308405 Jul 18 16:56:53.004157 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 360/724] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:52 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1713 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:53.113003 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b03c1fbf-c7e4-49ff-80b4-070f2be59451 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:53.113731 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b03c1fbf-c7e4-49ff-80b4-070f2be59451 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:53.121319 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b03c1fbf-c7e4-49ff-80b4-070f2be59451 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:53.123289 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b03c1fbf-c7e4-49ff-80b4-070f2be59451 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:53.123289 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b03c1fbf-c7e4-49ff-80b4-070f2be59451 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:53.123499 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b03c1fbf-c7e4-49ff-80b4-070f2be59451 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:53.126774 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:53.271017 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b03c1fbf-c7e4-49ff-80b4-070f2be59451 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:53.279252 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b03c1fbf-c7e4-49ff-80b4-070f2be59451 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.171889 Jul 18 16:56:53.279927 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 365/725] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:53 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:54.298400 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b9d2e17d-2ffd-470f-a12d-75425d1ff3ff tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:54.299009 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b9d2e17d-2ffd-470f-a12d-75425d1ff3ff tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:54.305782 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b9d2e17d-2ffd-470f-a12d-75425d1ff3ff tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:54.306240 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b9d2e17d-2ffd-470f-a12d-75425d1ff3ff tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:54.307012 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b9d2e17d-2ffd-470f-a12d-75425d1ff3ff tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:54.307449 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b9d2e17d-2ffd-470f-a12d-75425d1ff3ff tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:54.460591 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b9d2e17d-2ffd-470f-a12d-75425d1ff3ff tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:54.468682 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b9d2e17d-2ffd-470f-a12d-75425d1ff3ff tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.174779 Jul 18 16:56:54.469807 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 361/726] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:54 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:55.141951 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2c6264b9-77c5-4f5a-8fd4-a4b9d8b6ab7c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1555971275"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:55.142488 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2c6264b9-77c5-4f5a-8fd4-a4b9d8b6ab7c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:55.150378 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c6264b9-77c5-4f5a-8fd4-a4b9d8b6ab7c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:55.150921 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c6264b9-77c5-4f5a-8fd4-a4b9d8b6ab7c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:55.151717 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c6264b9-77c5-4f5a-8fd4-a4b9d8b6ab7c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:55.152158 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c6264b9-77c5-4f5a-8fd4-a4b9d8b6ab7c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:55.277588 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.network.security_group_api [None req-2c6264b9-77c5-4f5a-8fd4-a4b9d8b6ab7c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Adding security group 710a8612-eaa1-453d-92e4-b55922470eb9 to port ffbf241e-13b6-4507-9161-8a88eafc095a Jul 18 16:56:55.541916 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cbe78445-72ba-4e74-a4a1-59d36ed67766 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:55.541916 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cbe78445-72ba-4e74-a4a1-59d36ed67766 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:55.541916 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cbe78445-72ba-4e74-a4a1-59d36ed67766 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:55.541916 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cbe78445-72ba-4e74-a4a1-59d36ed67766 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:55.542810 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cbe78445-72ba-4e74-a4a1-59d36ed67766 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:55.542810 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cbe78445-72ba-4e74-a4a1-59d36ed67766 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:55.542810 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:55.639614 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cbe78445-72ba-4e74-a4a1-59d36ed67766 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:55.649170 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cbe78445-72ba-4e74-a4a1-59d36ed67766 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.166510 Jul 18 16:56:55.650390 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 362/727] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:55 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:55.704639 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2c6264b9-77c5-4f5a-8fd4-a4b9d8b6ab7c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "POST /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/action" status: 202 len: 0 microversion: 2.1 time: 0.566624 Jul 18 16:56:55.706390 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 366/728] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 16:56:55 2022] POST /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:56:55.717037 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f0263acb-72ed-4908-867b-f9e73b3c2e2c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:55.717777 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f0263acb-72ed-4908-867b-f9e73b3c2e2c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:55.722949 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-e0750608-6a75-4675-914f-b494c78760b3 req-b734b0ed-0ed3-4b3f-a89e-83f0e91b8b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb84650-2a5a-491b-a7fd-2b80fc1b8c57", "tag": "ffbf241e-13b6-4507-9161-8a88eafc095a"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:55.725764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f0263acb-72ed-4908-867b-f9e73b3c2e2c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:55.731635 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f0263acb-72ed-4908-867b-f9e73b3c2e2c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:55.732756 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-e0750608-6a75-4675-914f-b494c78760b3 req-b734b0ed-0ed3-4b3f-a89e-83f0e91b8b75 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:55.733259 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-e0750608-6a75-4675-914f-b494c78760b3 req-b734b0ed-0ed3-4b3f-a89e-83f0e91b8b75 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:55.733534 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f0263acb-72ed-4908-867b-f9e73b3c2e2c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:55.734199 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f0263acb-72ed-4908-867b-f9e73b3c2e2c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:55.755879 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-e0750608-6a75-4675-914f-b494c78760b3 req-b734b0ed-0ed3-4b3f-a89e-83f0e91b8b75 service nova] Creating event network-changed:ffbf241e-13b6-4507-9161-8a88eafc095a for instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 on hv-cinder-83754 Jul 18 16:56:55.761732 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-e0750608-6a75-4675-914f-b494c78760b3 req-b734b0ed-0ed3-4b3f-a89e-83f0e91b8b75 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043103 Jul 18 16:56:55.762783 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 367/729] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:55.939635 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f0263acb-72ed-4908-867b-f9e73b3c2e2c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:55.949766 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f0263acb-72ed-4908-867b-f9e73b3c2e2c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1760 microversion: 2.1 time: 0.237864 Jul 18 16:56:55.950685 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 363/730] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:55 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1760 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:56.668711 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-485d8e43-bc64-4acc-826c-2820b29eee8e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:56.669334 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-485d8e43-bc64-4acc-826c-2820b29eee8e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:56.676781 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-485d8e43-bc64-4acc-826c-2820b29eee8e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:56.677250 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-485d8e43-bc64-4acc-826c-2820b29eee8e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:56.678012 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-485d8e43-bc64-4acc-826c-2820b29eee8e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:56.678446 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-485d8e43-bc64-4acc-826c-2820b29eee8e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:56.812049 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-485d8e43-bc64-4acc-826c-2820b29eee8e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:56.820853 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-485d8e43-bc64-4acc-826c-2820b29eee8e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.156765 Jul 18 16:56:56.821446 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 368/731] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:56 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:57.838339 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dc0503a4-2eec-49e5-89a4-8eb6c507a3ac tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:57.838987 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dc0503a4-2eec-49e5-89a4-8eb6c507a3ac tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:57.845685 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc0503a4-2eec-49e5-89a4-8eb6c507a3ac tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:57.846181 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc0503a4-2eec-49e5-89a4-8eb6c507a3ac tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:57.846962 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc0503a4-2eec-49e5-89a4-8eb6c507a3ac tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:57.847405 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc0503a4-2eec-49e5-89a4-8eb6c507a3ac tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:57.981337 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dc0503a4-2eec-49e5-89a4-8eb6c507a3ac tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:57.990372 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dc0503a4-2eec-49e5-89a4-8eb6c507a3ac tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.155836 Jul 18 16:56:57.990959 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 364/732] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:57 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:59.008136 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bd5da342-81e9-4b41-ad9b-c605ee18f2ad tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:59.008752 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bd5da342-81e9-4b41-ad9b-c605ee18f2ad tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:59.015446 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bd5da342-81e9-4b41-ad9b-c605ee18f2ad tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:59.015891 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bd5da342-81e9-4b41-ad9b-c605ee18f2ad tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:59.016646 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bd5da342-81e9-4b41-ad9b-c605ee18f2ad tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:59.017110 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bd5da342-81e9-4b41-ad9b-c605ee18f2ad tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:59.152918 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-bd5da342-81e9-4b41-ad9b-c605ee18f2ad tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:59.162049 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bd5da342-81e9-4b41-ad9b-c605ee18f2ad tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.157717 Jul 18 16:56:59.162625 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 369/733] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:59 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:00.179425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-640577c1-a9fa-40cf-ad73-752f5a3421a8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:00.180027 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-640577c1-a9fa-40cf-ad73-752f5a3421a8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:00.186720 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-640577c1-a9fa-40cf-ad73-752f5a3421a8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:00.187162 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-640577c1-a9fa-40cf-ad73-752f5a3421a8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:00.187925 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-640577c1-a9fa-40cf-ad73-752f5a3421a8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:00.188351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-640577c1-a9fa-40cf-ad73-752f5a3421a8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:00.328464 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-640577c1-a9fa-40cf-ad73-752f5a3421a8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:00.337583 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-640577c1-a9fa-40cf-ad73-752f5a3421a8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.161904 Jul 18 16:57:00.338140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 365/734] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:00 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:01.356200 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8ddb4528-0941-4b47-9ca1-4a82f1e8282d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:01.356967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8ddb4528-0941-4b47-9ca1-4a82f1e8282d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:01.368688 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ddb4528-0941-4b47-9ca1-4a82f1e8282d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:01.369185 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ddb4528-0941-4b47-9ca1-4a82f1e8282d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:01.369981 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ddb4528-0941-4b47-9ca1-4a82f1e8282d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:01.370425 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ddb4528-0941-4b47-9ca1-4a82f1e8282d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:01.508986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8ddb4528-0941-4b47-9ca1-4a82f1e8282d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:01.517136 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8ddb4528-0941-4b47-9ca1-4a82f1e8282d tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.164769 Jul 18 16:57:01.517710 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 370/735] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:01 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:02.535805 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-89f7b35e-ad5d-4f5d-a902-178880575875 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:02.536422 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-89f7b35e-ad5d-4f5d-a902-178880575875 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:02.543053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-89f7b35e-ad5d-4f5d-a902-178880575875 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:02.544859 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-89f7b35e-ad5d-4f5d-a902-178880575875 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:02.544859 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-89f7b35e-ad5d-4f5d-a902-178880575875 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:02.544859 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-89f7b35e-ad5d-4f5d-a902-178880575875 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:02.678222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-89f7b35e-ad5d-4f5d-a902-178880575875 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:02.686278 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-89f7b35e-ad5d-4f5d-a902-178880575875 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.155115 Jul 18 16:57:02.686873 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 366/736] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:02 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:03.704724 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ac7367d2-399d-469a-9ec8-16ffda291846 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:03.706043 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ac7367d2-399d-469a-9ec8-16ffda291846 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:03.712494 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac7367d2-399d-469a-9ec8-16ffda291846 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:03.712961 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac7367d2-399d-469a-9ec8-16ffda291846 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:03.713744 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac7367d2-399d-469a-9ec8-16ffda291846 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:03.714178 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac7367d2-399d-469a-9ec8-16ffda291846 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:03.855136 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ac7367d2-399d-469a-9ec8-16ffda291846 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:03.864223 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ac7367d2-399d-469a-9ec8-16ffda291846 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.163383 Jul 18 16:57:03.864903 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 371/737] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:03 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:04.882051 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ae9e5cfd-8aff-47e7-bb18-f772f63c0a66 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:04.882695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ae9e5cfd-8aff-47e7-bb18-f772f63c0a66 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:04.889332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ae9e5cfd-8aff-47e7-bb18-f772f63c0a66 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:04.891192 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ae9e5cfd-8aff-47e7-bb18-f772f63c0a66 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:04.891192 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ae9e5cfd-8aff-47e7-bb18-f772f63c0a66 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:04.891821 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ae9e5cfd-8aff-47e7-bb18-f772f63c0a66 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:05.028812 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ae9e5cfd-8aff-47e7-bb18-f772f63c0a66 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:05.037593 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ae9e5cfd-8aff-47e7-bb18-f772f63c0a66 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.159514 Jul 18 16:57:05.038178 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 367/738] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:04 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:06.056153 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-298840cf-66a5-4dc8-a367-11d3fdf7903f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:06.056782 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-298840cf-66a5-4dc8-a367-11d3fdf7903f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:06.063436 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-298840cf-66a5-4dc8-a367-11d3fdf7903f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:06.063883 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-298840cf-66a5-4dc8-a367-11d3fdf7903f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:06.065306 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-298840cf-66a5-4dc8-a367-11d3fdf7903f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:06.065768 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-298840cf-66a5-4dc8-a367-11d3fdf7903f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:06.209670 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-298840cf-66a5-4dc8-a367-11d3fdf7903f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:06.217850 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-298840cf-66a5-4dc8-a367-11d3fdf7903f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.165897 Jul 18 16:57:06.218418 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 372/739] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:06 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:07.235268 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4f11a5e7-e0ee-4e35-b3d7-3b079f4d7cfc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:07.236231 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4f11a5e7-e0ee-4e35-b3d7-3b079f4d7cfc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:07.238749 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=46 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:07.243618 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4f11a5e7-e0ee-4e35-b3d7-3b079f4d7cfc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:07.246829 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4f11a5e7-e0ee-4e35-b3d7-3b079f4d7cfc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:07.246829 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4f11a5e7-e0ee-4e35-b3d7-3b079f4d7cfc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:07.246829 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4f11a5e7-e0ee-4e35-b3d7-3b079f4d7cfc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:07.716789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4f11a5e7-e0ee-4e35-b3d7-3b079f4d7cfc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:07.726265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4f11a5e7-e0ee-4e35-b3d7-3b079f4d7cfc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1737 microversion: 2.1 time: 0.494760 Jul 18 16:57:07.726855 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 368/740] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:07 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1737 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:08.743716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8e3742dc-eea9-425f-b144-b43222689ee8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:08.744323 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8e3742dc-eea9-425f-b144-b43222689ee8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:08.750942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8e3742dc-eea9-425f-b144-b43222689ee8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:08.751392 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8e3742dc-eea9-425f-b144-b43222689ee8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:08.752433 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8e3742dc-eea9-425f-b144-b43222689ee8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:08.752889 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8e3742dc-eea9-425f-b144-b43222689ee8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:08.886184 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8e3742dc-eea9-425f-b144-b43222689ee8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:08.897120 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8e3742dc-eea9-425f-b144-b43222689ee8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1717 microversion: 2.1 time: 0.157101 Jul 18 16:57:08.897716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 373/741] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:08 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:08.981873 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-84c5ded9-10db-47a9-a65f-9760438013b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:08.982424 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-84c5ded9-10db-47a9-a65f-9760438013b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:08.991096 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-84c5ded9-10db-47a9-a65f-9760438013b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:08.991559 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-84c5ded9-10db-47a9-a65f-9760438013b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:08.992331 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-84c5ded9-10db-47a9-a65f-9760438013b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:08.992765 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-84c5ded9-10db-47a9-a65f-9760438013b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:09.121630 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-84c5ded9-10db-47a9-a65f-9760438013b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] HTTP exception thrown: Cannot 'detach_volume' instance 10246df8-f808-47a9-947f-af78a2fd64c9 while it is in vm_state rescued Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-84c5ded9-10db-47a9-a65f-9760438013b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Request method failure captured: Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments/b925ab20-5c59-4b2d-9819-65db70036e52 HTTP/1.1 Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-TiVRFIxQUFS3o-vF1tU9Gsir476hfPwg6-9QY-ekQJczP403moh-x5hK5fdr7Kyenyms_fsEbsImWQwwhBO-dS1lqDFJndVpqEGo5Vn-47C8Aj-o3gFI_Qx_JhbRvmzfNos5WqnfrA286SqwZvQAoPFHOJXCA-yaId_liYvjAawc Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 2e5e262f0ed548ee8a4450d0d4806667 Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 16:57:09.123254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 16:57:09.124866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:57:09.124866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:57:09.124866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 2e5e262f0ed548ee8a4450d0d4806667 Jul 18 16:57:09.124866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:57:09.124866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-ServerRescueNegativeTestJSON-1412367741-project Jul 18 16:57:09.124866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 16:57:09.124866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 16:57:09.124866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 4d27db5cdd9e453dbd93b862db694309 Jul 18 16:57:09.124866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1412367741-project Jul 18 16:57:09.124866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 16:57:09.124866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Cannot 'detach_volume' instance 10246df8-f808-47a9-947f-af78a2fd64c9 while it is in vm_state rescued Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'server_id': '10246df8-f808-47a9-947f-af78a2fd64c9', 'id': 'b925ab20-5c59-4b2d-9819-65db70036e52'} Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 10246df8-f808-47a9-947f-af78a2fd64c9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:57:09.125815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 10246df8-f808-47a9-947f-af78a2fd64c9 while it is in vm_state rescued Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 10246df8-f808-47a9-947f-af78a2fd64c9 while it is in vm_state rescued Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:57:09.127481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-84c5ded9-10db-47a9-a65f-9760438013b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Returning 409 to user: Cannot 'detach_volume' instance 10246df8-f808-47a9-947f-af78a2fd64c9 while it is in vm_state rescued {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:57:09.128788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-84c5ded9-10db-47a9-a65f-9760438013b6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "DELETE /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments/b925ab20-5c59-4b2d-9819-65db70036e52" status: 409 len: 152 microversion: 2.1 time: 0.147104 Jul 18 16:57:09.128788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 369/742] 10.222.0.76 () {58 vars in 1415 bytes} [Mon Jul 18 16:57:08 2022] DELETE /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments/b925ab20-5c59-4b2d-9819-65db70036e52 => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 16:57:09.134080 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f090898d-cbd2-4243-956d-f0bbaaa76e5c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:09.134609 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f090898d-cbd2-4243-956d-f0bbaaa76e5c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:09.140955 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f090898d-cbd2-4243-956d-f0bbaaa76e5c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:09.141456 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f090898d-cbd2-4243-956d-f0bbaaa76e5c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:09.142271 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f090898d-cbd2-4243-956d-f0bbaaa76e5c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:09.143240 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f090898d-cbd2-4243-956d-f0bbaaa76e5c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:09.365920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f090898d-cbd2-4243-956d-f0bbaaa76e5c tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "POST /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/action" status: 202 len: 0 microversion: 2.1 time: 0.234945 Jul 18 16:57:09.367710 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 374/743] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 16:57:09 2022] POST /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:57:09.379844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f11a5df6-76be-47ae-b04a-d025e68023b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:09.380948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f11a5df6-76be-47ae-b04a-d025e68023b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:09.390154 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f11a5df6-76be-47ae-b04a-d025e68023b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:09.390655 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f11a5df6-76be-47ae-b04a-d025e68023b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:09.391500 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f11a5df6-76be-47ae-b04a-d025e68023b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:09.392036 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f11a5df6-76be-47ae-b04a-d025e68023b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:09.569628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f11a5df6-76be-47ae-b04a-d025e68023b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:09.579601 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f11a5df6-76be-47ae-b04a-d025e68023b4 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1725 microversion: 2.1 time: 0.206978 Jul 18 16:57:09.580948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 370/744] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:09 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:10.607470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-70dc5096-cfa0-4996-84a9-73696816fbdc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:10.608154 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-70dc5096-cfa0-4996-84a9-73696816fbdc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:10.615461 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-70dc5096-cfa0-4996-84a9-73696816fbdc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:10.615909 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-70dc5096-cfa0-4996-84a9-73696816fbdc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:10.616677 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-70dc5096-cfa0-4996-84a9-73696816fbdc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:10.617143 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-70dc5096-cfa0-4996-84a9-73696816fbdc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:10.756747 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-70dc5096-cfa0-4996-84a9-73696816fbdc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:10.764930 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-70dc5096-cfa0-4996-84a9-73696816fbdc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1725 microversion: 2.1 time: 0.162217 Jul 18 16:57:10.765517 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 375/745] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:10 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:11.782964 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a9eb7530-d5d3-4ff4-b472-0f0ec967e838 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:11.783597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a9eb7530-d5d3-4ff4-b472-0f0ec967e838 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:11.789724 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a9eb7530-d5d3-4ff4-b472-0f0ec967e838 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:11.790172 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a9eb7530-d5d3-4ff4-b472-0f0ec967e838 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:11.791032 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a9eb7530-d5d3-4ff4-b472-0f0ec967e838 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:11.791495 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a9eb7530-d5d3-4ff4-b472-0f0ec967e838 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:11.925373 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a9eb7530-d5d3-4ff4-b472-0f0ec967e838 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:11.933303 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a9eb7530-d5d3-4ff4-b472-0f0ec967e838 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1725 microversion: 2.1 time: 0.154462 Jul 18 16:57:11.933991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 371/746] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:11 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:12.951025 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-835e3d26-4b44-41ce-ba3a-73d19a6aaaea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:12.951636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-835e3d26-4b44-41ce-ba3a-73d19a6aaaea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:12.959085 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-835e3d26-4b44-41ce-ba3a-73d19a6aaaea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:12.959537 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-835e3d26-4b44-41ce-ba3a-73d19a6aaaea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:12.960441 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-835e3d26-4b44-41ce-ba3a-73d19a6aaaea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:12.960882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-835e3d26-4b44-41ce-ba3a-73d19a6aaaea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:13.096930 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-835e3d26-4b44-41ce-ba3a-73d19a6aaaea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:13.104945 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-835e3d26-4b44-41ce-ba3a-73d19a6aaaea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1725 microversion: 2.1 time: 0.157821 Jul 18 16:57:13.105574 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 376/747] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:12 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:14.123249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a7ef372e-26e9-4750-9150-c988244773ba tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:14.124094 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a7ef372e-26e9-4750-9150-c988244773ba tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:14.131055 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a7ef372e-26e9-4750-9150-c988244773ba tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:14.131504 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a7ef372e-26e9-4750-9150-c988244773ba tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:14.132268 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a7ef372e-26e9-4750-9150-c988244773ba tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:14.132703 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a7ef372e-26e9-4750-9150-c988244773ba tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:14.265150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a7ef372e-26e9-4750-9150-c988244773ba tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:14.273727 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a7ef372e-26e9-4750-9150-c988244773ba tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1731 microversion: 2.1 time: 0.154325 Jul 18 16:57:14.274283 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 372/748] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:14 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:14.291332 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-81b18f2f-e74e-4ebc-9e2f-e9bfc1946c4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:14.291857 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-81b18f2f-e74e-4ebc-9e2f-e9bfc1946c4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:14.298384 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81b18f2f-e74e-4ebc-9e2f-e9bfc1946c4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:14.299334 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81b18f2f-e74e-4ebc-9e2f-e9bfc1946c4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:14.300108 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81b18f2f-e74e-4ebc-9e2f-e9bfc1946c4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:14.300544 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81b18f2f-e74e-4ebc-9e2f-e9bfc1946c4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:14.388398 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-81b18f2f-e74e-4ebc-9e2f-e9bfc1946c4f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101086 Jul 18 16:57:14.389403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 377/749] 10.222.0.76 () {58 vars in 1274 bytes} [Mon Jul 18 16:57:14 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:15.370167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-d94c094d-52d9-4da4-959d-56402bfb64ed req-ec88f59f-2e02-4e9e-9b09-8492f2c4105e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10246df8-f808-47a9-947f-af78a2fd64c9", "tag": "4df48297-725a-439e-bb47-a2b832df545f"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:15.381110 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-d94c094d-52d9-4da4-959d-56402bfb64ed req-ec88f59f-2e02-4e9e-9b09-8492f2c4105e service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:15.381807 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-d94c094d-52d9-4da4-959d-56402bfb64ed req-ec88f59f-2e02-4e9e-9b09-8492f2c4105e service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:15.393354 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-d94c094d-52d9-4da4-959d-56402bfb64ed req-ec88f59f-2e02-4e9e-9b09-8492f2c4105e service nova] Creating event network-changed:4df48297-725a-439e-bb47-a2b832df545f for instance 10246df8-f808-47a9-947f-af78a2fd64c9 on hv-cinder-83754 Jul 18 16:57:15.398757 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-d94c094d-52d9-4da4-959d-56402bfb64ed req-ec88f59f-2e02-4e9e-9b09-8492f2c4105e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033152 Jul 18 16:57:15.399321 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 373/750] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:17.414547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-6df0e995-b1cc-4302-b9bf-48e3d987b775 req-66da30d0-3eb4-4867-a819-853869895c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10246df8-f808-47a9-947f-af78a2fd64c9", "tag": "4df48297-725a-439e-bb47-a2b832df545f"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:17.422534 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-6df0e995-b1cc-4302-b9bf-48e3d987b775 req-66da30d0-3eb4-4867-a819-853869895c7b service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:17.422970 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-6df0e995-b1cc-4302-b9bf-48e3d987b775 req-66da30d0-3eb4-4867-a819-853869895c7b service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:17.434507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-6df0e995-b1cc-4302-b9bf-48e3d987b775 req-66da30d0-3eb4-4867-a819-853869895c7b service nova] Creating event network-changed:4df48297-725a-439e-bb47-a2b832df545f for instance 10246df8-f808-47a9-947f-af78a2fd64c9 on hv-cinder-83754 Jul 18 16:57:17.439995 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-6df0e995-b1cc-4302-b9bf-48e3d987b775 req-66da30d0-3eb4-4867-a819-853869895c7b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029085 Jul 18 16:57:17.440553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 378/751] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:45.379146 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=11 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:45.379894 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=65 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:45.384140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9d998a2c-c824-4771-833b-0214ae09247a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:45.384730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9d998a2c-c824-4771-833b-0214ae09247a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:45.391084 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d998a2c-c824-4771-833b-0214ae09247a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:45.391541 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d998a2c-c824-4771-833b-0214ae09247a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:45.392485 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d998a2c-c824-4771-833b-0214ae09247a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:45.392930 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d998a2c-c824-4771-833b-0214ae09247a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:45.419007 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9d998a2c-c824-4771-833b-0214ae09247a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:57:46.115290 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9d998a2c-c824-4771-833b-0214ae09247a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "DELETE /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 204 len: 0 microversion: 2.1 time: 0.737824 Jul 18 16:57:46.115887 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 374/752] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 16:57:45 2022] DELETE /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 0 bytes in 740 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:57:46.122068 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=31 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:46.124257 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:46.126878 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-14d779a1-f149-4f46-a59d-b0d79135d29b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:46.127573 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-14d779a1-f149-4f46-a59d-b0d79135d29b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:46.133993 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14d779a1-f149-4f46-a59d-b0d79135d29b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:46.134451 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14d779a1-f149-4f46-a59d-b0d79135d29b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:46.135228 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14d779a1-f149-4f46-a59d-b0d79135d29b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:46.135675 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14d779a1-f149-4f46-a59d-b0d79135d29b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:46.275891 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-14d779a1-f149-4f46-a59d-b0d79135d29b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:46.283646 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-14d779a1-f149-4f46-a59d-b0d79135d29b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1577 microversion: 2.1 time: 0.163342 Jul 18 16:57:46.284209 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 379/753] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:46 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:47.302993 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0b31d2e6-ec1d-4e3b-aa1c-96c6e68b1c74 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:47.303875 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0b31d2e6-ec1d-4e3b-aa1c-96c6e68b1c74 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:47.310880 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b31d2e6-ec1d-4e3b-aa1c-96c6e68b1c74 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:47.311333 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b31d2e6-ec1d-4e3b-aa1c-96c6e68b1c74 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:47.312158 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b31d2e6-ec1d-4e3b-aa1c-96c6e68b1c74 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:47.312627 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0b31d2e6-ec1d-4e3b-aa1c-96c6e68b1c74 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:47.463833 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0b31d2e6-ec1d-4e3b-aa1c-96c6e68b1c74 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:47.463833 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0b31d2e6-ec1d-4e3b-aa1c-96c6e68b1c74 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1577 microversion: 2.1 time: 0.163740 Jul 18 16:57:47.463833 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 375/754] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:47 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:48.481585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-20c4135d-a56c-4428-b8be-6ca22083fcde tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:48.482291 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-20c4135d-a56c-4428-b8be-6ca22083fcde tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:48.489623 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-20c4135d-a56c-4428-b8be-6ca22083fcde tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:48.490077 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-20c4135d-a56c-4428-b8be-6ca22083fcde tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:48.490961 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-20c4135d-a56c-4428-b8be-6ca22083fcde tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:48.491553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-20c4135d-a56c-4428-b8be-6ca22083fcde tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:48.631834 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-20c4135d-a56c-4428-b8be-6ca22083fcde tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:48.639512 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-20c4135d-a56c-4428-b8be-6ca22083fcde tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1577 microversion: 2.1 time: 0.162804 Jul 18 16:57:48.640091 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 380/755] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:48 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:49.507476 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-94574a55-2c90-486d-bce2-d2d50b531787 req-8b6f2615-ebc9-4fef-839e-0db17554f72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11140d5e-70e4-4716-ac6c-cef98b91640c", "name": "network-vif-deleted", "tag": "bfb84bf6-a98e-4f78-9794-d40806a09eb5"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:49.517177 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-94574a55-2c90-486d-bce2-d2d50b531787 req-8b6f2615-ebc9-4fef-839e-0db17554f72f service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:49.519136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-94574a55-2c90-486d-bce2-d2d50b531787 req-8b6f2615-ebc9-4fef-839e-0db17554f72f service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:49.531155 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-94574a55-2c90-486d-bce2-d2d50b531787 req-8b6f2615-ebc9-4fef-839e-0db17554f72f service nova] Creating event network-vif-deleted:bfb84bf6-a98e-4f78-9794-d40806a09eb5 for instance 11140d5e-70e4-4716-ac6c-cef98b91640c on hv-cinder-83754 Jul 18 16:57:49.536274 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-94574a55-2c90-486d-bce2-d2d50b531787 req-8b6f2615-ebc9-4fef-839e-0db17554f72f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144392 Jul 18 16:57:49.537112 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 376/756] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:49.657923 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7454147d-cdd5-4b82-8f2f-7d324b0cac35 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:49.658567 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7454147d-cdd5-4b82-8f2f-7d324b0cac35 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:49.666373 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7454147d-cdd5-4b82-8f2f-7d324b0cac35 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:49.666816 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7454147d-cdd5-4b82-8f2f-7d324b0cac35 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:49.667600 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7454147d-cdd5-4b82-8f2f-7d324b0cac35 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:49.668032 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7454147d-cdd5-4b82-8f2f-7d324b0cac35 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:49.741527 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7454147d-cdd5-4b82-8f2f-7d324b0cac35 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:49.749497 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7454147d-cdd5-4b82-8f2f-7d324b0cac35 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1226 microversion: 2.1 time: 0.095554 Jul 18 16:57:49.750086 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 381/757] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:49 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:50.773139 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1890d6fd-c4f5-4447-a52b-c2fd411c5580 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:50.773960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1890d6fd-c4f5-4447-a52b-c2fd411c5580 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:50.780992 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1890d6fd-c4f5-4447-a52b-c2fd411c5580 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:50.781457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1890d6fd-c4f5-4447-a52b-c2fd411c5580 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:50.782272 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1890d6fd-c4f5-4447-a52b-c2fd411c5580 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:50.782710 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1890d6fd-c4f5-4447-a52b-c2fd411c5580 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:50.822895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1890d6fd-c4f5-4447-a52b-c2fd411c5580 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:50.823260 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1890d6fd-c4f5-4447-a52b-c2fd411c5580 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:50.823713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-1890d6fd-c4f5-4447-a52b-c2fd411c5580 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lazy-loading 'fault' on Instance uuid 11140d5e-70e4-4716-ac6c-cef98b91640c {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:57:50.867598 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1890d6fd-c4f5-4447-a52b-c2fd411c5580 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:50.875270 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1890d6fd-c4f5-4447-a52b-c2fd411c5580 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 200 len: 1231 microversion: 2.1 time: 0.107659 Jul 18 16:57:50.875840 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 377/758] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:50 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 1231 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:51.892381 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-829dcb67-2ee0-4f83-8c65-7a772165bc00 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:51.892920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-829dcb67-2ee0-4f83-8c65-7a772165bc00 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:51.899360 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-829dcb67-2ee0-4f83-8c65-7a772165bc00 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:51.899812 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-829dcb67-2ee0-4f83-8c65-7a772165bc00 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:51.900576 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-829dcb67-2ee0-4f83-8c65-7a772165bc00 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:51.901029 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-829dcb67-2ee0-4f83-8c65-7a772165bc00 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:51.914151 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-829dcb67-2ee0-4f83-8c65-7a772165bc00 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] HTTP exception thrown: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-829dcb67-2ee0-4f83-8c65-7a772165bc00 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Request method failure captured: Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c HTTP/1.1 Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1ZAW45tf-ENfewcMUQEQN3d3TEIMWs_3d-y6pvASiuvpL6MwUL4uSy8Y0Acg2NzQG_BedrYuOQ2FRzude0kvF9E2LfOwcj-cTTFxdaL1F5nYNOs0AQWJwxm_Q_-4wc7oozlIpzXtOBSVrxIX_T_p4VHuKuaozxX02JrEaqWI093VWf8 Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 997c256859f2484e8465c043b3d2299d Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-TestVolumeBootPattern-626268263 Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:57:51.915797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:57:51.917400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_997c256859f2484e8465c043b3d2299d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/997c256859f2484e8465c043b3d2299d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/997c256859f2484e8465c043b3d2299d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/997c256859f2484e8465c043b3d2299d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:57:51.917400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-TestVolumeBootPattern-626268263 Jul 18 16:57:51.917400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 997c256859f2484e8465c043b3d2299d Jul 18 16:57:51.917400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-TestVolumeBootPattern-626268263 Jul 18 16:57:51.917400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-TestVolumeBootPattern-626268263-project Jul 18 16:57:51.917400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:57:51.917400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:57:51.917400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 4ad27549c1824d45b1d55653e2c121a8 Jul 18 16:57:51.917400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-TestVolumeBootPattern-626268263-project Jul 18 16:57:51.917400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 16:57:51.917400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 16:57:51.917400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '11140d5e-70e4-4716-ac6c-cef98b91640c'} Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:57:51.918275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 16:57:51.919511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:57:51.920606 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-829dcb67-2ee0-4f83-8c65-7a772165bc00 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Returning 404 to user: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:57:51.920606 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-829dcb67-2ee0-4f83-8c65-7a772165bc00 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 404 len: 111 microversion: 2.1 time: 0.028831 Jul 18 16:57:51.920606 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 382/759] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:51 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:57:52.017110 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-997602531", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1291189408", "security_groups": [{"name": "tempest-secgroup-smoke-806392402"}], "block_device_mapping_v2": [{"uuid": "4ba1ffb6-3c10-4722-9cbb-67e918a93340", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ed716b42-439d-44c6-b097-74d923cb2bde"}]}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:52.135199 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] validate_networks() for [('ed716b42-439d-44c6-b097-74d923cb2bde', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:57:52.577063 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:57:52.577505 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:57:52.577981 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:57:52.578385 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:57:52.578792 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:57:52.588415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:52.588858 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:52.589681 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:52.590115 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:52.607226 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Getting quotas for project 997c256859f2484e8465c043b3d2299d. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:57:52.611347 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Getting quotas for user 4ad27549c1824d45b1d55653e2c121a8 and project 997c256859f2484e8465c043b3d2299d. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:57:52.668382 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:57:52.670536 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4ba1ffb6-3c10-4722-9cbb-67e918a93340',volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:57:53.086490 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR oslo.messaging._drivers.impl_rabbit [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [bab10cb9-6cfa-40f8-81a6-0f035ca8b3ae] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 16:57:54.093600 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [bab10cb9-6cfa-40f8-81a6-0f035ca8b3ae] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 60364. Jul 18 16:57:54.097854 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-719956c6-09f3-4ccb-b66b-0f55415735b5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.084722 Jul 18 16:57:54.098547 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 378/760] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:57:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:57:54.109268 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-81230aa3-4d99-4372-bd22-2dc747c80a60 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:54.109886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-81230aa3-4d99-4372-bd22-2dc747c80a60 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:54.166749 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-81230aa3-4d99-4372-bd22-2dc747c80a60 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:54.174391 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-81230aa3-4d99-4372-bd22-2dc747c80a60 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1094 microversion: 2.1 time: 0.068936 Jul 18 16:57:54.175540 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 383/761] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:54 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:55.191616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0aa29bed-da3f-4c91-b010-f7f3b66e4939 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:55.197222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0aa29bed-da3f-4c91-b010-f7f3b66e4939 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:55.199236 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0aa29bed-da3f-4c91-b010-f7f3b66e4939 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:55.199584 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0aa29bed-da3f-4c91-b010-f7f3b66e4939 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:55.200354 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0aa29bed-da3f-4c91-b010-f7f3b66e4939 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:55.200794 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0aa29bed-da3f-4c91-b010-f7f3b66e4939 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:55.263440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0aa29bed-da3f-4c91-b010-f7f3b66e4939 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:55.271040 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0aa29bed-da3f-4c91-b010-f7f3b66e4939 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1144 microversion: 2.1 time: 0.083907 Jul 18 16:57:55.272247 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 379/762] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:55 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:56.288946 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-57f3d78f-fce4-4769-867b-d0269156f5ca tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:56.289691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-57f3d78f-fce4-4769-867b-d0269156f5ca tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:56.298307 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-57f3d78f-fce4-4769-867b-d0269156f5ca tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:56.298769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-57f3d78f-fce4-4769-867b-d0269156f5ca tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:56.299546 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-57f3d78f-fce4-4769-867b-d0269156f5ca tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:56.299992 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-57f3d78f-fce4-4769-867b-d0269156f5ca tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:56.362492 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-57f3d78f-fce4-4769-867b-d0269156f5ca tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:56.370619 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-57f3d78f-fce4-4769-867b-d0269156f5ca tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1192 microversion: 2.1 time: 0.086115 Jul 18 16:57:56.371179 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 384/763] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:56 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:57.002446 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3ef8540b-a1f3-4eac-a6dd-6626e6d6bc11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:57.003037 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3ef8540b-a1f3-4eac-a6dd-6626e6d6bc11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:57.010430 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ef8540b-a1f3-4eac-a6dd-6626e6d6bc11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:57.010883 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ef8540b-a1f3-4eac-a6dd-6626e6d6bc11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:57.011654 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ef8540b-a1f3-4eac-a6dd-6626e6d6bc11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:57.012095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ef8540b-a1f3-4eac-a6dd-6626e6d6bc11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:57.042224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3ef8540b-a1f3-4eac-a6dd-6626e6d6bc11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments/b57f5656-044a-47bb-ae85-a9d2acc4965a" status: 200 len: 194 microversion: 2.20 time: 0.044086 Jul 18 16:57:57.042820 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 380/764] 10.222.0.76 () {60 vars in 1453 bytes} [Mon Jul 18 16:57:56 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments/b57f5656-044a-47bb-ae85-a9d2acc4965a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:57:57.107745 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2152b021-7850-4c9b-9d53-d8c5d5a41fd6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:57.108262 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2152b021-7850-4c9b-9d53-d8c5d5a41fd6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:57.114692 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2152b021-7850-4c9b-9d53-d8c5d5a41fd6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:57.115800 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2152b021-7850-4c9b-9d53-d8c5d5a41fd6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:57.116574 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2152b021-7850-4c9b-9d53-d8c5d5a41fd6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:57.117027 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2152b021-7850-4c9b-9d53-d8c5d5a41fd6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:57.248365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-2152b021-7850-4c9b-9d53-d8c5d5a41fd6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lazy-loading 'services' on Instance uuid c3d31815-4f8c-4e76-adcb-8039b88488d0 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:57:57.387774 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0d756ec1-ffce-481d-8013-1efc3e801f6f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:57.388480 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0d756ec1-ffce-481d-8013-1efc3e801f6f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:57.395306 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d756ec1-ffce-481d-8013-1efc3e801f6f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:57.395979 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d756ec1-ffce-481d-8013-1efc3e801f6f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:57.397104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d756ec1-ffce-481d-8013-1efc3e801f6f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:57.397922 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d756ec1-ffce-481d-8013-1efc3e801f6f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:57.520644 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2152b021-7850-4c9b-9d53-d8c5d5a41fd6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments/b57f5656-044a-47bb-ae85-a9d2acc4965a" status: 202 len: 0 microversion: 2.20 time: 0.416731 Jul 18 16:57:57.524842 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 385/765] 10.222.0.76 () {60 vars in 1456 bytes} [Mon Jul 18 16:57:57 2022] DELETE /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments/b57f5656-044a-47bb-ae85-a9d2acc4965a => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:57:57.530895 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c9601022-8db1-4fcf-9104-0760a2125b1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:57.532279 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c9601022-8db1-4fcf-9104-0760a2125b1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:57.541631 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c9601022-8db1-4fcf-9104-0760a2125b1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:57.542128 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c9601022-8db1-4fcf-9104-0760a2125b1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:57.542858 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c9601022-8db1-4fcf-9104-0760a2125b1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:57.543293 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c9601022-8db1-4fcf-9104-0760a2125b1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:57.576749 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c9601022-8db1-4fcf-9104-0760a2125b1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050357 Jul 18 16:57:57.577341 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 386/766] 10.222.0.76 () {60 vars in 1342 bytes} [Mon Jul 18 16:57:57 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:57:57.622302 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0d756ec1-ffce-481d-8013-1efc3e801f6f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:57.641163 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0d756ec1-ffce-481d-8013-1efc3e801f6f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1277 microversion: 2.1 time: 0.257041 Jul 18 16:57:57.641785 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 381/767] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:57 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:58.296164 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-836c4660-f91a-40d0-a1e2-7e9113423958 req-0f2cfb77-310a-48fc-8ffa-8c8a047e7dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59d02fb-6042-4f0e-a98a-38c41602027a", "tag": "b1ef0b33-c13f-4547-a433-408579d14c01"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:58.306505 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-836c4660-f91a-40d0-a1e2-7e9113423958 req-0f2cfb77-310a-48fc-8ffa-8c8a047e7dfd service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:58.307056 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-836c4660-f91a-40d0-a1e2-7e9113423958 req-0f2cfb77-310a-48fc-8ffa-8c8a047e7dfd service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:58.319634 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-836c4660-f91a-40d0-a1e2-7e9113423958 req-0f2cfb77-310a-48fc-8ffa-8c8a047e7dfd service nova] Creating event network-changed:b1ef0b33-c13f-4547-a433-408579d14c01 for instance e59d02fb-6042-4f0e-a98a-38c41602027a on hv-cinder-83754 Jul 18 16:57:58.325509 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-836c4660-f91a-40d0-a1e2-7e9113423958 req-0f2cfb77-310a-48fc-8ffa-8c8a047e7dfd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032951 Jul 18 16:57:58.326472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 387/768] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:58.588473 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ac6571d8-d180-4333-bdb6-2202943a9cb2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:58.589432 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ac6571d8-d180-4333-bdb6-2202943a9cb2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:58.595936 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac6571d8-d180-4333-bdb6-2202943a9cb2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:58.596380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac6571d8-d180-4333-bdb6-2202943a9cb2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:58.597169 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac6571d8-d180-4333-bdb6-2202943a9cb2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:58.597625 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac6571d8-d180-4333-bdb6-2202943a9cb2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:58.627478 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ac6571d8-d180-4333-bdb6-2202943a9cb2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043533 Jul 18 16:57:58.628035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 382/769] 10.222.0.76 () {60 vars in 1342 bytes} [Mon Jul 18 16:57:58 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:57:58.659198 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a440242c-0a47-4394-a6c9-11075e56a4bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:58.659888 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a440242c-0a47-4394-a6c9-11075e56a4bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:58.667136 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a440242c-0a47-4394-a6c9-11075e56a4bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:58.667584 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a440242c-0a47-4394-a6c9-11075e56a4bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:58.668342 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a440242c-0a47-4394-a6c9-11075e56a4bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:58.668777 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a440242c-0a47-4394-a6c9-11075e56a4bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:58.812130 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a440242c-0a47-4394-a6c9-11075e56a4bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:58.821547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a440242c-0a47-4394-a6c9-11075e56a4bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1277 microversion: 2.1 time: 0.166367 Jul 18 16:57:58.822915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 388/770] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:58 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:59.640028 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a45154ff-c7c6-40cc-a4f9-42946499732c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:59.641076 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a45154ff-c7c6-40cc-a4f9-42946499732c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:59.647783 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a45154ff-c7c6-40cc-a4f9-42946499732c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:59.648220 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a45154ff-c7c6-40cc-a4f9-42946499732c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:59.649123 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a45154ff-c7c6-40cc-a4f9-42946499732c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:59.649631 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a45154ff-c7c6-40cc-a4f9-42946499732c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:59.683605 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a45154ff-c7c6-40cc-a4f9-42946499732c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047827 Jul 18 16:57:59.687674 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 383/771] 10.222.0.76 () {60 vars in 1342 bytes} [Mon Jul 18 16:57:59 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:57:59.839768 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6b44e325-8191-413a-8ae1-073dde815a7a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:59.840390 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6b44e325-8191-413a-8ae1-073dde815a7a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:59.847310 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6b44e325-8191-413a-8ae1-073dde815a7a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:59.847768 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6b44e325-8191-413a-8ae1-073dde815a7a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:59.848573 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6b44e325-8191-413a-8ae1-073dde815a7a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:59.849106 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6b44e325-8191-413a-8ae1-073dde815a7a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:59.992693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6b44e325-8191-413a-8ae1-073dde815a7a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:00.000471 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6b44e325-8191-413a-8ae1-073dde815a7a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1265 microversion: 2.1 time: 0.164656 Jul 18 16:58:00.001070 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 389/772] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:59 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:00.696080 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8c686185-be2e-4ab3-8772-68a5ba2dc8ea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:00.697037 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8c686185-be2e-4ab3-8772-68a5ba2dc8ea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:00.703486 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8c686185-be2e-4ab3-8772-68a5ba2dc8ea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:00.703937 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8c686185-be2e-4ab3-8772-68a5ba2dc8ea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:00.704694 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8c686185-be2e-4ab3-8772-68a5ba2dc8ea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:00.705169 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8c686185-be2e-4ab3-8772-68a5ba2dc8ea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:00.735445 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8c686185-be2e-4ab3-8772-68a5ba2dc8ea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043928 Jul 18 16:58:00.736009 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 384/773] 10.222.0.76 () {60 vars in 1342 bytes} [Mon Jul 18 16:58:00 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:00.799143 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-29388ec0-d7a3-41df-bb53-c83f0e988f50 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:00.799631 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-29388ec0-d7a3-41df-bb53-c83f0e988f50 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:00.806271 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29388ec0-d7a3-41df-bb53-c83f0e988f50 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:00.809174 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29388ec0-d7a3-41df-bb53-c83f0e988f50 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:00.809174 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29388ec0-d7a3-41df-bb53-c83f0e988f50 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:00.809174 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29388ec0-d7a3-41df-bb53-c83f0e988f50 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:00.833390 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-29388ec0-d7a3-41df-bb53-c83f0e988f50 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:58:01.034199 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e2fb4794-bf9a-4c73-bd6b-ed04c4b102e1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:01.034828 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e2fb4794-bf9a-4c73-bd6b-ed04c4b102e1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:01.041953 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e2fb4794-bf9a-4c73-bd6b-ed04c4b102e1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:01.047326 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e2fb4794-bf9a-4c73-bd6b-ed04c4b102e1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:01.047326 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e2fb4794-bf9a-4c73-bd6b-ed04c4b102e1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:01.047326 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e2fb4794-bf9a-4c73-bd6b-ed04c4b102e1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:01.168021 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-29388ec0-d7a3-41df-bb53-c83f0e988f50 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 204 len: 0 microversion: 2.20 time: 0.371924 Jul 18 16:58:01.169055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 390/774] 10.222.0.76 () {60 vars in 1279 bytes} [Mon Jul 18 16:58:00 2022] DELETE /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 16:58:01.182258 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b9296a08-ce92-45cb-b780-b32b246df4ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:01.187747 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b9296a08-ce92-45cb-b780-b32b246df4ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:01.187997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e2fb4794-bf9a-4c73-bd6b-ed04c4b102e1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:01.189282 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b9296a08-ce92-45cb-b780-b32b246df4ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:01.189739 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b9296a08-ce92-45cb-b780-b32b246df4ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:01.190586 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b9296a08-ce92-45cb-b780-b32b246df4ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:01.190960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b9296a08-ce92-45cb-b780-b32b246df4ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:01.193780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e2fb4794-bf9a-4c73-bd6b-ed04c4b102e1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1265 microversion: 2.1 time: 0.163492 Jul 18 16:58:01.194363 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 385/775] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:01 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:01.325872 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b9296a08-ce92-45cb-b780-b32b246df4ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:01.334681 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b9296a08-ce92-45cb-b780-b32b246df4ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:01.336217 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b9296a08-ce92-45cb-b780-b32b246df4ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:01.337418 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b9296a08-ce92-45cb-b780-b32b246df4ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.160845 Jul 18 16:58:01.337976 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 391/776] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:01 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:02.211672 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-93cd24f4-09ce-4838-9d61-efc994fe0067 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:02.212282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-93cd24f4-09ce-4838-9d61-efc994fe0067 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:02.219015 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93cd24f4-09ce-4838-9d61-efc994fe0067 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:02.219463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93cd24f4-09ce-4838-9d61-efc994fe0067 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:02.220298 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93cd24f4-09ce-4838-9d61-efc994fe0067 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:02.220729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93cd24f4-09ce-4838-9d61-efc994fe0067 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:02.355867 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-670bd7a3-2d16-4420-bdbc-ba2ce8abff42 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:02.356578 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-670bd7a3-2d16-4420-bdbc-ba2ce8abff42 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:02.362126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-93cd24f4-09ce-4838-9d61-efc994fe0067 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:02.364081 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-670bd7a3-2d16-4420-bdbc-ba2ce8abff42 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:02.364571 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-670bd7a3-2d16-4420-bdbc-ba2ce8abff42 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:02.365904 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-670bd7a3-2d16-4420-bdbc-ba2ce8abff42 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:02.366555 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-670bd7a3-2d16-4420-bdbc-ba2ce8abff42 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:02.370920 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-93cd24f4-09ce-4838-9d61-efc994fe0067 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1265 microversion: 2.1 time: 0.163437 Jul 18 16:58:02.371494 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 386/777] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:02 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:02.500261 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-670bd7a3-2d16-4420-bdbc-ba2ce8abff42 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:02.509233 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-670bd7a3-2d16-4420-bdbc-ba2ce8abff42 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:02.510725 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-670bd7a3-2d16-4420-bdbc-ba2ce8abff42 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:02.511912 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-670bd7a3-2d16-4420-bdbc-ba2ce8abff42 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.159969 Jul 18 16:58:02.512474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 392/778] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:02 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:03.388211 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ad41a974-259e-422f-825a-d0ea34c8132f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:03.388816 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ad41a974-259e-422f-825a-d0ea34c8132f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:03.390813 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:03.391490 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=6 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:03.396804 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ad41a974-259e-422f-825a-d0ea34c8132f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:03.398069 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ad41a974-259e-422f-825a-d0ea34c8132f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:03.398788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ad41a974-259e-422f-825a-d0ea34c8132f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:03.399202 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ad41a974-259e-422f-825a-d0ea34c8132f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:03.530936 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-29d06ebf-ed4f-48ab-af10-68613a9ae68d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:03.531547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-29d06ebf-ed4f-48ab-af10-68613a9ae68d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:03.536197 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ad41a974-259e-422f-825a-d0ea34c8132f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:03.539189 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29d06ebf-ed4f-48ab-af10-68613a9ae68d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:03.539720 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29d06ebf-ed4f-48ab-af10-68613a9ae68d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:03.540569 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29d06ebf-ed4f-48ab-af10-68613a9ae68d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:03.541033 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29d06ebf-ed4f-48ab-af10-68613a9ae68d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:03.544995 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ad41a974-259e-422f-825a-d0ea34c8132f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1265 microversion: 2.1 time: 0.160540 Jul 18 16:58:03.545626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 387/779] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:03 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:03.828054 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-29d06ebf-ed4f-48ab-af10-68613a9ae68d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:03.836711 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-29d06ebf-ed4f-48ab-af10-68613a9ae68d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:03.838285 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-29d06ebf-ed4f-48ab-af10-68613a9ae68d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:03.839467 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-29d06ebf-ed4f-48ab-af10-68613a9ae68d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1725 microversion: 2.20 time: 0.312745 Jul 18 16:58:03.840019 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 393/780] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:03 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1725 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:04.566974 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-13350e83-a96d-4e71-b243-6542695c67bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:04.568146 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-13350e83-a96d-4e71-b243-6542695c67bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:04.578214 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13350e83-a96d-4e71-b243-6542695c67bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:04.579018 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13350e83-a96d-4e71-b243-6542695c67bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:04.580371 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13350e83-a96d-4e71-b243-6542695c67bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:04.581190 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13350e83-a96d-4e71-b243-6542695c67bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:04.804479 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-13350e83-a96d-4e71-b243-6542695c67bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:04.812127 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-13350e83-a96d-4e71-b243-6542695c67bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1265 microversion: 2.1 time: 0.252412 Jul 18 16:58:04.812710 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 388/781] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:04 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:04.863183 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9f1c7cb1-80ec-4001-bfdf-2f6da177680f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:04.864361 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9f1c7cb1-80ec-4001-bfdf-2f6da177680f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:04.871500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:04.873761 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9f1c7cb1-80ec-4001-bfdf-2f6da177680f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:04.874222 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9f1c7cb1-80ec-4001-bfdf-2f6da177680f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:04.875013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9f1c7cb1-80ec-4001-bfdf-2f6da177680f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:04.875453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9f1c7cb1-80ec-4001-bfdf-2f6da177680f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:04.926804 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-2752badc-2ba1-4472-b834-7c66ce606160 req-43b0714e-d98a-46cb-a0f0-bb2ca987e8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d31815-4f8c-4e76-adcb-8039b88488d0", "name": "network-vif-deleted", "tag": "cbb20d80-19a9-48b1-be96-866c4a0904d4"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:04.936114 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-2752badc-2ba1-4472-b834-7c66ce606160 req-43b0714e-d98a-46cb-a0f0-bb2ca987e8fb service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:04.936564 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-2752badc-2ba1-4472-b834-7c66ce606160 req-43b0714e-d98a-46cb-a0f0-bb2ca987e8fb service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:04.963526 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-2752badc-2ba1-4472-b834-7c66ce606160 req-43b0714e-d98a-46cb-a0f0-bb2ca987e8fb service nova] Creating event network-vif-deleted:cbb20d80-19a9-48b1-be96-866c4a0904d4 for instance c3d31815-4f8c-4e76-adcb-8039b88488d0 on hv-cinder-83754 Jul 18 16:58:04.964609 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9f1c7cb1-80ec-4001-bfdf-2f6da177680f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:04.969654 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-2752badc-2ba1-4472-b834-7c66ce606160 req-43b0714e-d98a-46cb-a0f0-bb2ca987e8fb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046633 Jul 18 16:58:04.973258 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9f1c7cb1-80ec-4001-bfdf-2f6da177680f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:04.973851 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 389/782] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:58:04.974742 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9f1c7cb1-80ec-4001-bfdf-2f6da177680f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:04.976496 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9f1c7cb1-80ec-4001-bfdf-2f6da177680f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1658 microversion: 2.20 time: 0.120532 Jul 18 16:58:04.981051 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 394/783] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:04 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1658 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:05.831349 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c62a2853-3c79-4b1a-bbdb-fc3cfe7ee051 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:05.832044 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c62a2853-3c79-4b1a-bbdb-fc3cfe7ee051 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:05.839726 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c62a2853-3c79-4b1a-bbdb-fc3cfe7ee051 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:05.840712 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c62a2853-3c79-4b1a-bbdb-fc3cfe7ee051 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:05.841120 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c62a2853-3c79-4b1a-bbdb-fc3cfe7ee051 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:05.841557 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c62a2853-3c79-4b1a-bbdb-fc3cfe7ee051 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:05.861837 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:06.104230 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c62a2853-3c79-4b1a-bbdb-fc3cfe7ee051 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:06.106175 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-36856525-81e5-46ef-89d5-ed4d76c0921b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:06.106175 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-36856525-81e5-46ef-89d5-ed4d76c0921b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:06.107716 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c62a2853-3c79-4b1a-bbdb-fc3cfe7ee051 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1265 microversion: 2.1 time: 0.173114 Jul 18 16:58:06.107716 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 390/784] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:05 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:06.107906 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-36856525-81e5-46ef-89d5-ed4d76c0921b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:06.107906 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-36856525-81e5-46ef-89d5-ed4d76c0921b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:06.107906 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-36856525-81e5-46ef-89d5-ed4d76c0921b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:06.107906 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-36856525-81e5-46ef-89d5-ed4d76c0921b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:06.108246 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:06.108246 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-36856525-81e5-46ef-89d5-ed4d76c0921b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:06.108246 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-36856525-81e5-46ef-89d5-ed4d76c0921b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:06.108246 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-36856525-81e5-46ef-89d5-ed4d76c0921b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lazy-loading 'fault' on Instance uuid c3d31815-4f8c-4e76-adcb-8039b88488d0 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:06.108596 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-36856525-81e5-46ef-89d5-ed4d76c0921b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:06.108596 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-36856525-81e5-46ef-89d5-ed4d76c0921b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:06.108793 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-36856525-81e5-46ef-89d5-ed4d76c0921b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:06.108793 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-36856525-81e5-46ef-89d5-ed4d76c0921b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 200 len: 1372 microversion: 2.20 time: 0.099683 Jul 18 16:58:06.108793 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 395/785] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:05 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:06.957850 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:58:06.958095 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Mon Jul 18 16:58:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:58:07.017527 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ec46b43c-c1f0-4c47-a2fc-05f9ee0c04ee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:07.018142 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ec46b43c-c1f0-4c47-a2fc-05f9ee0c04ee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:07.026226 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec46b43c-c1f0-4c47-a2fc-05f9ee0c04ee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:07.026744 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec46b43c-c1f0-4c47-a2fc-05f9ee0c04ee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:07.027523 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec46b43c-c1f0-4c47-a2fc-05f9ee0c04ee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:07.027963 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec46b43c-c1f0-4c47-a2fc-05f9ee0c04ee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:07.112213 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9a464399-b60e-47e4-8cec-a50a9468fe0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:07.112813 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9a464399-b60e-47e4-8cec-a50a9468fe0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:07.121822 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a464399-b60e-47e4-8cec-a50a9468fe0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:07.122185 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a464399-b60e-47e4-8cec-a50a9468fe0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:07.123003 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a464399-b60e-47e4-8cec-a50a9468fe0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:07.123422 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a464399-b60e-47e4-8cec-a50a9468fe0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:07.136894 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-9a464399-b60e-47e4-8cec-a50a9468fe0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] HTTP exception thrown: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9a464399-b60e-47e4-8cec-a50a9468fe0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Request method failure captured: Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 HTTP/1.1 Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y-NJ-wbbiM9xCJbwFdrWzQjcz8YP3PFl0CMVulbm24L9VEOFZP79jbUbWmemkNpAqTGGSGXAPJNE_o9qqZOhqh_ZtOK0N-1p5u8yeTSMz1hZVlCbkQ9zwwyX-fyKBparcazCUtobVwtJrsFnNWXvhWr6GmIJTXsrdVv3lGQGA2exv8 Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: d75a7e8f1e294903ade7a227878079f8 Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:58:07.138630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:58:07.140564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:58:07.140564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 16:58:07.140564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: d75a7e8f1e294903ade7a227878079f8 Jul 18 16:58:07.140564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 16:58:07.140564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeShelveTestJSON-332693562-project Jul 18 16:58:07.140564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:58:07.140564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:58:07.140564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 9faf38f2ccec4b60a3612648073d06d3 Jul 18 16:58:07.140564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-332693562-project Jul 18 16:58:07.140564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 16:58:07.140564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 16:58:07.140564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': 'c3d31815-4f8c-4e76-adcb-8039b88488d0'} Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:58:07.141462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 16:58:07.142773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:07.143886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9a464399-b60e-47e4-8cec-a50a9468fe0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Returning 404 to user: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:58:07.143886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9a464399-b60e-47e4-8cec-a50a9468fe0c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 404 len: 111 microversion: 2.20 time: 0.032094 Jul 18 16:58:07.143886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 396/786] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:07 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:58:07.149321 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-952a47d1-e807-42c6-82f9-ee94e4e27c2e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '.version_select at 0x7f4af5e3d1f0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:07.173311 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ec46b43c-c1f0-4c47-a2fc-05f9ee0c04ee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:07.181802 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ec46b43c-c1f0-4c47-a2fc-05f9ee0c04ee tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1265 microversion: 2.1 time: 0.168256 Jul 18 16:58:07.182391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 391/787] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:07 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:07.258172 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-952a47d1-e807-42c6-82f9-ee94e4e27c2e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946998672" status: 204 len: 0 microversion: 2.20 time: 0.113040 Jul 18 16:58:07.258739 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 397/788] 10.222.0.76 () {60 vars in 1261 bytes} [Mon Jul 18 16:58:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946998672 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 16:58:08.082239 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a4bf5608-b273-408e-8b9e-aa07c0039de1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Action: 'create', calling method: .version_select at 0x7f4af14a0a60>, body: {"keypair": {"name": "tempest-keypair-661138906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzMMj0RujeIit/2TXMr1/mrxrUrCnw25fdhDw2ody+DwzuBkwf91ziDzVH5E1i4PRt/OUzaRelKGfoFTTcS7S9Tn71hKTU6UIwjtxMG8WvAo7aUslaEhoms9QrvA0NEqA=="}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:08.097325 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-a4bf5608-b273-408e-8b9e-aa07c0039de1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Getting quotas for project d75a7e8f1e294903ade7a227878079f8. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:58:08.101279 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-a4bf5608-b273-408e-8b9e-aa07c0039de1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Getting quotas for user 9faf38f2ccec4b60a3612648073d06d3 and project d75a7e8f1e294903ade7a227878079f8. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:58:08.184323 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a4bf5608-b273-408e-8b9e-aa07c0039de1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.105915 Jul 18 16:58:08.184945 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 392/789] 10.222.0.76 () {62 vars in 1199 bytes} [Mon Jul 18 16:58:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 16:58:08.200297 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3a966139-987c-4222-a4a1-d36598e1e3a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:08.204980 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3a966139-987c-4222-a4a1-d36598e1e3a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:08.207863 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a966139-987c-4222-a4a1-d36598e1e3a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:08.208381 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a966139-987c-4222-a4a1-d36598e1e3a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:08.209262 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a966139-987c-4222-a4a1-d36598e1e3a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:08.209885 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a966139-987c-4222-a4a1-d36598e1e3a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:08.372687 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3a966139-987c-4222-a4a1-d36598e1e3a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:08.381988 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3a966139-987c-4222-a4a1-d36598e1e3a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1265 microversion: 2.1 time: 0.185426 Jul 18 16:58:08.382832 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 398/790] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:08 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:09.271527 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c7ede1d3-f808-492c-8a74-8f2b33dd157f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:09.272995 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c7ede1d3-f808-492c-8a74-8f2b33dd157f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:09.279034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c7ede1d3-f808-492c-8a74-8f2b33dd157f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.279489 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c7ede1d3-f808-492c-8a74-8f2b33dd157f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.280301 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c7ede1d3-f808-492c-8a74-8f2b33dd157f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.280746 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c7ede1d3-f808-492c-8a74-8f2b33dd157f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.305404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c7ede1d3-f808-492c-8a74-8f2b33dd157f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9/ips" status: 200 len: 150 microversion: 2.1 time: 0.091152 Jul 18 16:58:09.312998 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 393/791] 10.222.0.76 () {58 vars in 1247 bytes} [Mon Jul 18 16:58:09 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9/ips => generated 150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:09.316381 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8b8ef1bc-ee9d-4e31-ba00-fce35a4c82a1 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48968069-af81-48e8-ab60-6562f51bb0bd"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:09.317509 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8b8ef1bc-ee9d-4e31-ba00-fce35a4c82a1 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:09.324588 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8b8ef1bc-ee9d-4e31-ba00-fce35a4c82a1 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.325067 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8b8ef1bc-ee9d-4e31-ba00-fce35a4c82a1 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.325836 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8b8ef1bc-ee9d-4e31-ba00-fce35a4c82a1 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.326274 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8b8ef1bc-ee9d-4e31-ba00-fce35a4c82a1 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.401186 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2268ea33-9ed5-4686-9da9-e02fdf963cd7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:09.401817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2268ea33-9ed5-4686-9da9-e02fdf963cd7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:09.408279 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2268ea33-9ed5-4686-9da9-e02fdf963cd7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.408856 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2268ea33-9ed5-4686-9da9-e02fdf963cd7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.409819 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2268ea33-9ed5-4686-9da9-e02fdf963cd7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.410336 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2268ea33-9ed5-4686-9da9-e02fdf963cd7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.414182 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-8b8ef1bc-ee9d-4e31-ba00-fce35a4c82a1 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Invalid volume: volume 48968069-af81-48e8-ab60-6562f51bb0bd is already attached to instances: b57c0d06-7394-47d2-ab8b-2445e996c9bd Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8b8ef1bc-ee9d-4e31-ba00-fce35a4c82a1 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: POST /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9/os-volume_attachments HTTP/1.1 Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 74 Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:58:09.417308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:58:09.426472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:58:09.426472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 16:58:09.426472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 16:58:09.426472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 16:58:09.426472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 16:58:09.426472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:58:09.426472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:58:09.426472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 16:58:09.426472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 16:58:09.426472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Jul 18 16:58:09.426472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {"volumeAttachment": {"volumeId": "48968069-af81-48e8-ab60-6562f51bb0bd"}} Jul 18 16:58:09.426472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Invalid volume: volume 48968069-af81-48e8-ab60-6562f51bb0bd is already attached to instances: b57c0d06-7394-47d2-ab8b-2445e996c9bd Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'server_id': '0a961f74-97c0-4862-a288-ff06a9aa55e9', 'body': {'volumeAttachment': {'volumeId': '48968069-af81-48e8-ab60-6562f51bb0bd'}}} Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 48968069-af81-48e8-ab60-6562f51bb0bd is already attached to instances: b57c0d06-7394-47d2-ab8b-2445e996c9bd Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:09.427549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 48968069-af81-48e8-ab60-6562f51bb0bd is already attached to instances: b57c0d06-7394-47d2-ab8b-2445e996c9bd Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:09.428960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:58:09.430404 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:58:09.430404 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:58:09.430404 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:58:09.430404 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 48968069-af81-48e8-ab60-6562f51bb0bd is already attached to instances: b57c0d06-7394-47d2-ab8b-2445e996c9bd Jul 18 16:58:09.430404 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:09.430404 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8b8ef1bc-ee9d-4e31-ba00-fce35a4c82a1 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 400 to user: Invalid volume: volume 48968069-af81-48e8-ab60-6562f51bb0bd is already attached to instances: b57c0d06-7394-47d2-ab8b-2445e996c9bd {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:58:09.430404 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8b8ef1bc-ee9d-4e31-ba00-fce35a4c82a1 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "POST /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106451 Jul 18 16:58:09.430404 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 399/792] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 16:58:09 2022] POST /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:58:09.433909 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b37c7571-e2b3-4016-9442-465d292ec3da tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:09.434412 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b37c7571-e2b3-4016-9442-465d292ec3da tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:09.440814 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b37c7571-e2b3-4016-9442-465d292ec3da tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.441299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b37c7571-e2b3-4016-9442-465d292ec3da tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.442077 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b37c7571-e2b3-4016-9442-465d292ec3da tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.442512 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b37c7571-e2b3-4016-9442-465d292ec3da tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.470305 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b37c7571-e2b3-4016-9442-465d292ec3da tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:58:09.554790 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2268ea33-9ed5-4686-9da9-e02fdf963cd7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:09.563783 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2268ea33-9ed5-4686-9da9-e02fdf963cd7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1265 microversion: 2.1 time: 0.168130 Jul 18 16:58:09.567279 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 394/793] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:09 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:09.788346 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b37c7571-e2b3-4016-9442-465d292ec3da tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 204 len: 0 microversion: 2.1 time: 0.357937 Jul 18 16:58:09.796446 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 400/794] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 16:58:09 2022] DELETE /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:58:09.796688 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-980aff4f-232d-4cb5-8dd3-3031cdb92296 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:09.796688 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-980aff4f-232d-4cb5-8dd3-3031cdb92296 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:09.797862 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-73184734-e4d3-4d64-9818-c3bcb475dc23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:09.798755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-73184734-e4d3-4d64-9818-c3bcb475dc23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:09.803964 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-980aff4f-232d-4cb5-8dd3-3031cdb92296 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.804926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-980aff4f-232d-4cb5-8dd3-3031cdb92296 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.805733 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-980aff4f-232d-4cb5-8dd3-3031cdb92296 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.806090 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73184734-e4d3-4d64-9818-c3bcb475dc23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.806340 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-980aff4f-232d-4cb5-8dd3-3031cdb92296 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.806679 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73184734-e4d3-4d64-9818-c3bcb475dc23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.808230 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73184734-e4d3-4d64-9818-c3bcb475dc23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.808780 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73184734-e4d3-4d64-9818-c3bcb475dc23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.895774 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-980aff4f-232d-4cb5-8dd3-3031cdb92296 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lazy-loading 'services' on Instance uuid 2f8d5ca4-1bea-450f-8560-c07717d110e6 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:09.957458 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-73184734-e4d3-4d64-9818-c3bcb475dc23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:09.965729 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-73184734-e4d3-4d64-9818-c3bcb475dc23 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1682 microversion: 2.1 time: 0.172008 Jul 18 16:58:09.966309 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 401/795] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:09 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:10.262162 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-980aff4f-232d-4cb5-8dd3-3031cdb92296 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/os-volume_attachments/82fba666-ad36-4e50-bcb4-1d11a0f269db" status: 202 len: 0 microversion: 2.1 time: 0.615623 Jul 18 16:58:10.262747 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 395/796] 10.222.0.76 () {58 vars in 1415 bytes} [Mon Jul 18 16:58:09 2022] DELETE /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/os-volume_attachments/82fba666-ad36-4e50-bcb4-1d11a0f269db => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:58:10.582100 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e50ae82d-2347-4013-8ab2-19266e552641 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:10.582815 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e50ae82d-2347-4013-8ab2-19266e552641 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:10.589915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e50ae82d-2347-4013-8ab2-19266e552641 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:10.590406 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e50ae82d-2347-4013-8ab2-19266e552641 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:10.591253 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e50ae82d-2347-4013-8ab2-19266e552641 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:10.591721 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e50ae82d-2347-4013-8ab2-19266e552641 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:10.797766 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e50ae82d-2347-4013-8ab2-19266e552641 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:10.806574 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e50ae82d-2347-4013-8ab2-19266e552641 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1265 microversion: 2.1 time: 0.228431 Jul 18 16:58:10.807129 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 402/797] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:10 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:10.984643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e38fa91d-2727-458c-90ea-d06454f2203a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:10.985379 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e38fa91d-2727-458c-90ea-d06454f2203a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:10.992931 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e38fa91d-2727-458c-90ea-d06454f2203a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:10.993417 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e38fa91d-2727-458c-90ea-d06454f2203a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:10.994189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e38fa91d-2727-458c-90ea-d06454f2203a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:10.994631 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e38fa91d-2727-458c-90ea-d06454f2203a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:11.102006 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2035514735", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6631fbb-d13e-4de4-82dc-3ba51817ec4e"}], "security_groups": [{"name": "tempest-securitygroup--1472321125"}], "key_name": "tempest-keypair-661138906", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:11.136645 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e38fa91d-2727-458c-90ea-d06454f2203a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:11.145112 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e38fa91d-2727-458c-90ea-d06454f2203a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1682 microversion: 2.1 time: 0.164805 Jul 18 16:58:11.145721 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 396/798] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:10 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:11.221304 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] validate_networks() for [('c6631fbb-d13e-4de4-82dc-3ba51817ec4e', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:58:11.339276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-e3b8394c-5a0d-442d-bbb1-dcf637667aa2 req-d0f4ad04-7f93-4ebf-b590-5e6b9e5b57f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59d02fb-6042-4f0e-a98a-38c41602027a", "name": "network-vif-plugged", "status": "completed", "tag": "b1ef0b33-c13f-4547-a433-408579d14c01"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:11.352832 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e3b8394c-5a0d-442d-bbb1-dcf637667aa2 req-d0f4ad04-7f93-4ebf-b590-5e6b9e5b57f8 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:11.353315 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e3b8394c-5a0d-442d-bbb1-dcf637667aa2 req-d0f4ad04-7f93-4ebf-b590-5e6b9e5b57f8 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:11.379640 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-e3b8394c-5a0d-442d-bbb1-dcf637667aa2 req-d0f4ad04-7f93-4ebf-b590-5e6b9e5b57f8 service nova] Creating event network-vif-plugged:b1ef0b33-c13f-4547-a433-408579d14c01 for instance e59d02fb-6042-4f0e-a98a-38c41602027a on hv-cinder-83754 Jul 18 16:58:11.389116 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-e3b8394c-5a0d-442d-bbb1-dcf637667aa2 req-d0f4ad04-7f93-4ebf-b590-5e6b9e5b57f8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122040 Jul 18 16:58:11.390253 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 397/799] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:58:11.681548 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:58:11.682036 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:58:11.682472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:58:11.682886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:58:11.683302 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:58:11.692908 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:11.693920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:11.694971 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:11.695414 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:11.712967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Getting quotas for project d75a7e8f1e294903ade7a227878079f8. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:58:11.717574 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Getting quotas for user 9faf38f2ccec4b60a3612648073d06d3 and project d75a7e8f1e294903ade7a227878079f8. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:58:11.729145 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:58:11.731753 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:58:11.824861 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ae20339d-045f-4b22-bc0b-f36d1c5c3517 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:11.825593 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ae20339d-045f-4b22-bc0b-f36d1c5c3517 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:11.831906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ae20339d-045f-4b22-bc0b-f36d1c5c3517 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:11.832357 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ae20339d-045f-4b22-bc0b-f36d1c5c3517 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:11.833158 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ae20339d-045f-4b22-bc0b-f36d1c5c3517 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:11.833597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ae20339d-045f-4b22-bc0b-f36d1c5c3517 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:11.889531 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-21ebc900-e87c-4c67-8dc5-e0b6aa08c66e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.793701 Jul 18 16:58:11.891108 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 403/800] 10.222.0.76 () {62 vars in 1187 bytes} [Mon Jul 18 16:58:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 16:58:11.902455 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7d0a5931-27a2-4f49-8df7-ce4702a1b0e5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:11.903555 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7d0a5931-27a2-4f49-8df7-ce4702a1b0e5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:11.960240 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7d0a5931-27a2-4f49-8df7-ce4702a1b0e5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:11.968067 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7d0a5931-27a2-4f49-8df7-ce4702a1b0e5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:11.969692 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7d0a5931-27a2-4f49-8df7-ce4702a1b0e5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:11.970808 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7d0a5931-27a2-4f49-8df7-ce4702a1b0e5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1281 microversion: 2.20 time: 0.072712 Jul 18 16:58:11.971341 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 404/801] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:11 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:11.984366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ae20339d-045f-4b22-bc0b-f36d1c5c3517 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:11.993196 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ae20339d-045f-4b22-bc0b-f36d1c5c3517 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1265 microversion: 2.1 time: 0.172477 Jul 18 16:58:11.993823 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 398/802] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:11 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:12.162989 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b554e78f-beb5-4ab5-8288-a9f9b31c3988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:12.163654 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b554e78f-beb5-4ab5-8288-a9f9b31c3988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:12.170008 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b554e78f-beb5-4ab5-8288-a9f9b31c3988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:12.170462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b554e78f-beb5-4ab5-8288-a9f9b31c3988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:12.171244 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b554e78f-beb5-4ab5-8288-a9f9b31c3988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:12.171685 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b554e78f-beb5-4ab5-8288-a9f9b31c3988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:12.306591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b554e78f-beb5-4ab5-8288-a9f9b31c3988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:12.317793 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b554e78f-beb5-4ab5-8288-a9f9b31c3988 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1682 microversion: 2.1 time: 0.158223 Jul 18 16:58:12.319306 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 405/803] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:12 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:12.988264 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-871adeda-f016-42ad-9718-5f8287930435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:12.989053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-871adeda-f016-42ad-9718-5f8287930435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:13.011190 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d57e856f-ef72-4625-b171-d32ad8e18853 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:13.011802 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d57e856f-ef72-4625-b171-d32ad8e18853 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:13.018144 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d57e856f-ef72-4625-b171-d32ad8e18853 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:13.018663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d57e856f-ef72-4625-b171-d32ad8e18853 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:13.019494 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d57e856f-ef72-4625-b171-d32ad8e18853 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:13.019962 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d57e856f-ef72-4625-b171-d32ad8e18853 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:13.046499 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-871adeda-f016-42ad-9718-5f8287930435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:13.054185 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-871adeda-f016-42ad-9718-5f8287930435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:13.055691 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-871adeda-f016-42ad-9718-5f8287930435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:13.056803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-871adeda-f016-42ad-9718-5f8287930435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1281 microversion: 2.20 time: 0.072747 Jul 18 16:58:13.057814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 399/804] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:12 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:13.171457 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d57e856f-ef72-4625-b171-d32ad8e18853 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:13.180021 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d57e856f-ef72-4625-b171-d32ad8e18853 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1265 microversion: 2.1 time: 0.172986 Jul 18 16:58:13.182601 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 406/805] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:13 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:13.343911 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8b4c1251-96a0-4987-983a-73f9bd271091 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:13.343911 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8b4c1251-96a0-4987-983a-73f9bd271091 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:13.351776 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b4c1251-96a0-4987-983a-73f9bd271091 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:13.352317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b4c1251-96a0-4987-983a-73f9bd271091 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:13.353247 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b4c1251-96a0-4987-983a-73f9bd271091 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:13.353796 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b4c1251-96a0-4987-983a-73f9bd271091 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:13.377567 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-e57d35ec-f8ac-4e82-a065-c195d5fcef8e req-2f942b4b-b28a-4930-8e28-8d297aaf5f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a961f74-97c0-4862-a288-ff06a9aa55e9", "name": "network-vif-deleted", "tag": "ccdc3f7f-7e82-4dab-94cd-51b784a19c64"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:13.386552 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-e57d35ec-f8ac-4e82-a065-c195d5fcef8e req-2f942b4b-b28a-4930-8e28-8d297aaf5f23 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:13.387141 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-e57d35ec-f8ac-4e82-a065-c195d5fcef8e req-2f942b4b-b28a-4930-8e28-8d297aaf5f23 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:13.399489 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-e57d35ec-f8ac-4e82-a065-c195d5fcef8e req-2f942b4b-b28a-4930-8e28-8d297aaf5f23 service nova] Creating event network-vif-deleted:ccdc3f7f-7e82-4dab-94cd-51b784a19c64 for instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 on hv-cinder-83754 Jul 18 16:58:13.406229 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-e57d35ec-f8ac-4e82-a065-c195d5fcef8e req-2f942b4b-b28a-4930-8e28-8d297aaf5f23 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032102 Jul 18 16:58:13.407039 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 407/806] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:13.429619 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8b4c1251-96a0-4987-983a-73f9bd271091 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:13.437616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8b4c1251-96a0-4987-983a-73f9bd271091 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1614 microversion: 2.1 time: 0.098587 Jul 18 16:58:13.438200 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 400/807] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:13 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1614 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:13.482160 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-681dcf8c-f065-495e-b722-01d78672dae5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:13.482802 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-681dcf8c-f065-495e-b722-01d78672dae5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:13.489715 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-681dcf8c-f065-495e-b722-01d78672dae5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:13.490695 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-681dcf8c-f065-495e-b722-01d78672dae5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:13.491472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-681dcf8c-f065-495e-b722-01d78672dae5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:13.492087 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-681dcf8c-f065-495e-b722-01d78672dae5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:13.517594 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-681dcf8c-f065-495e-b722-01d78672dae5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lazy-loading 'flavor' on Instance uuid 87d25fa4-9505-4471-a0be-e3a486297f2d {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:13.519270 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-60fb1492-f587-47be-923b-a318477bc6a7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:13.530942 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60fb1492-f587-47be-923b-a318477bc6a7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:13.531795 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60fb1492-f587-47be-923b-a318477bc6a7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:13.558470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-60fb1492-f587-47be-923b-a318477bc6a7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Going to try to stop instance {{(pid=124868) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 16:58:13.963130 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-60fb1492-f587-47be-923b-a318477bc6a7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "POST /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/action" status: 202 len: 0 microversion: 2.1 time: 0.447592 Jul 18 16:58:13.967226 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 401/808] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 16:58:13 2022] POST /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:58:13.978199 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f95058ca-f7e4-4511-99f6-bd14e071fe8a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:13.978907 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f95058ca-f7e4-4511-99f6-bd14e071fe8a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:13.997292 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-681dcf8c-f065-495e-b722-01d78672dae5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "POST /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d/action" status: 202 len: 0 microversion: 2.1 time: 0.519126 Jul 18 16:58:13.997906 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 408/809] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 16:58:13 2022] POST /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:58:14.007137 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f95058ca-f7e4-4511-99f6-bd14e071fe8a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:14.007589 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f95058ca-f7e4-4511-99f6-bd14e071fe8a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:14.008450 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f95058ca-f7e4-4511-99f6-bd14e071fe8a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:14.008890 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f95058ca-f7e4-4511-99f6-bd14e071fe8a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:14.013618 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c2de6823-d27b-4b5a-a1cb-15928228a999 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:14.017932 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c2de6823-d27b-4b5a-a1cb-15928228a999 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:14.041619 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c2de6823-d27b-4b5a-a1cb-15928228a999 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:14.042209 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c2de6823-d27b-4b5a-a1cb-15928228a999 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:14.043078 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c2de6823-d27b-4b5a-a1cb-15928228a999 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:14.043599 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c2de6823-d27b-4b5a-a1cb-15928228a999 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:14.179491 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f95058ca-f7e4-4511-99f6-bd14e071fe8a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:14.187623 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f95058ca-f7e4-4511-99f6-bd14e071fe8a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1677 microversion: 2.1 time: 0.219043 Jul 18 16:58:14.189338 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 402/810] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:13 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:14.194654 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6b2b8621-abf7-42b8-b292-4288597d7af8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:14.196068 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6b2b8621-abf7-42b8-b292-4288597d7af8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:14.220755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c2de6823-d27b-4b5a-a1cb-15928228a999 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:14.229687 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c2de6823-d27b-4b5a-a1cb-15928228a999 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.225106 Jul 18 16:58:14.230274 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 409/811] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:14 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:14.238785 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-22d134cf-f60c-4520-8406-4a0b0816f407 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:14.239613 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-22d134cf-f60c-4520-8406-4a0b0816f407 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:14.243811 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:14.247368 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22d134cf-f60c-4520-8406-4a0b0816f407 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:14.248032 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22d134cf-f60c-4520-8406-4a0b0816f407 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:14.248847 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22d134cf-f60c-4520-8406-4a0b0816f407 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:14.249321 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22d134cf-f60c-4520-8406-4a0b0816f407 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:14.268392 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6b2b8621-abf7-42b8-b292-4288597d7af8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:14.276144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6b2b8621-abf7-42b8-b292-4288597d7af8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:14.277725 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6b2b8621-abf7-42b8-b292-4288597d7af8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:14.278881 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6b2b8621-abf7-42b8-b292-4288597d7af8 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1281 microversion: 2.20 time: 0.088486 Jul 18 16:58:14.279487 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 403/812] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:14 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:14.410857 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-22d134cf-f60c-4520-8406-4a0b0816f407 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:14.418916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-22d134cf-f60c-4520-8406-4a0b0816f407 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1265 microversion: 2.1 time: 0.187590 Jul 18 16:58:14.419515 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 410/813] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:14 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:14.455638 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-977ef4d2-3694-4f29-84bd-0710254fdaff tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:14.456343 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-977ef4d2-3694-4f29-84bd-0710254fdaff tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:14.459703 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:14.463575 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-977ef4d2-3694-4f29-84bd-0710254fdaff tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:14.464021 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-977ef4d2-3694-4f29-84bd-0710254fdaff tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:14.465532 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-977ef4d2-3694-4f29-84bd-0710254fdaff tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:14.465999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-977ef4d2-3694-4f29-84bd-0710254fdaff tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:14.504158 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-977ef4d2-3694-4f29-84bd-0710254fdaff tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:14.504707 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-977ef4d2-3694-4f29-84bd-0710254fdaff tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:14.505222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-977ef4d2-3694-4f29-84bd-0710254fdaff tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lazy-loading 'fault' on Instance uuid 0a961f74-97c0-4862-a288-ff06a9aa55e9 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:14.549073 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-977ef4d2-3694-4f29-84bd-0710254fdaff tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:14.557507 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-977ef4d2-3694-4f29-84bd-0710254fdaff tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1331 microversion: 2.1 time: 0.105845 Jul 18 16:58:14.558109 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 404/814] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:14 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:15.205758 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-40457012-b598-44b8-8732-5bd83dd7f027 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:15.206338 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-40457012-b598-44b8-8732-5bd83dd7f027 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:15.213884 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-40457012-b598-44b8-8732-5bd83dd7f027 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.214331 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-40457012-b598-44b8-8732-5bd83dd7f027 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.215091 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-40457012-b598-44b8-8732-5bd83dd7f027 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.215529 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-40457012-b598-44b8-8732-5bd83dd7f027 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.248088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-888e0f7f-f871-4bce-aeb9-50824c193690 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:15.249087 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-888e0f7f-f871-4bce-aeb9-50824c193690 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:15.256880 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-888e0f7f-f871-4bce-aeb9-50824c193690 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.257371 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-888e0f7f-f871-4bce-aeb9-50824c193690 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.258144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-888e0f7f-f871-4bce-aeb9-50824c193690 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.258611 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-888e0f7f-f871-4bce-aeb9-50824c193690 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.356120 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-40457012-b598-44b8-8732-5bd83dd7f027 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:15.371284 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-40457012-b598-44b8-8732-5bd83dd7f027 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1677 microversion: 2.1 time: 0.169267 Jul 18 16:58:15.371864 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 411/815] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:15 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:15.376502 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8fd32c86-3dc9-4e74-bfa6-a6fd0ece2829 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:15.377109 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8fd32c86-3dc9-4e74-bfa6-a6fd0ece2829 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:15.412435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-888e0f7f-f871-4bce-aeb9-50824c193690 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:15.420536 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-888e0f7f-f871-4bce-aeb9-50824c193690 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.176653 Jul 18 16:58:15.421581 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 405/816] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:15 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:15.436761 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8fd32c86-3dc9-4e74-bfa6-a6fd0ece2829 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:15.437455 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8378ba2b-7c3c-45f5-acc1-06d26cb2f9f0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:15.438059 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8378ba2b-7c3c-45f5-acc1-06d26cb2f9f0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:15.444724 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8378ba2b-7c3c-45f5-acc1-06d26cb2f9f0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.445069 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8fd32c86-3dc9-4e74-bfa6-a6fd0ece2829 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:15.445210 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8378ba2b-7c3c-45f5-acc1-06d26cb2f9f0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.445948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8378ba2b-7c3c-45f5-acc1-06d26cb2f9f0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.446416 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8378ba2b-7c3c-45f5-acc1-06d26cb2f9f0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.446653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8fd32c86-3dc9-4e74-bfa6-a6fd0ece2829 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:15.447774 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8fd32c86-3dc9-4e74-bfa6-a6fd0ece2829 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1281 microversion: 2.20 time: 0.074958 Jul 18 16:58:15.448376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 412/817] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:15 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:15.587431 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-be6cc076-df75-440f-96ab-d67d7a999553 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:15.588024 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-be6cc076-df75-440f-96ab-d67d7a999553 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:15.594161 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be6cc076-df75-440f-96ab-d67d7a999553 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.594611 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be6cc076-df75-440f-96ab-d67d7a999553 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.595381 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be6cc076-df75-440f-96ab-d67d7a999553 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.595817 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be6cc076-df75-440f-96ab-d67d7a999553 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.596893 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8378ba2b-7c3c-45f5-acc1-06d26cb2f9f0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:15.600751 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:15.606152 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8378ba2b-7c3c-45f5-acc1-06d26cb2f9f0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1451 microversion: 2.1 time: 0.172556 Jul 18 16:58:15.606820 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 406/818] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:15 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:15.623004 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a19c9451-7ad8-4c6b-a8f5-0931092237b4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:15.623613 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a19c9451-7ad8-4c6b-a8f5-0931092237b4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:15.628013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be6cc076-df75-440f-96ab-d67d7a999553 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.628467 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be6cc076-df75-440f-96ab-d67d7a999553 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.628927 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-be6cc076-df75-440f-96ab-d67d7a999553 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lazy-loading 'fault' on Instance uuid 0a961f74-97c0-4862-a288-ff06a9aa55e9 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:15.629629 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a19c9451-7ad8-4c6b-a8f5-0931092237b4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.630084 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a19c9451-7ad8-4c6b-a8f5-0931092237b4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.631494 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a19c9451-7ad8-4c6b-a8f5-0931092237b4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.631944 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a19c9451-7ad8-4c6b-a8f5-0931092237b4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.674616 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-be6cc076-df75-440f-96ab-d67d7a999553 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:15.683359 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-be6cc076-df75-440f-96ab-d67d7a999553 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 200 len: 1331 microversion: 2.1 time: 0.100301 Jul 18 16:58:15.683984 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 413/819] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:15 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:15.769583 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a19c9451-7ad8-4c6b-a8f5-0931092237b4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:15.777442 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a19c9451-7ad8-4c6b-a8f5-0931092237b4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1451 microversion: 2.1 time: 0.158051 Jul 18 16:58:15.778019 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 407/820] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:15 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:16.389204 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b4fd3fcb-a30c-4a3e-a187-66d27ad7b194 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:16.389855 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b4fd3fcb-a30c-4a3e-a187-66d27ad7b194 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:16.398820 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b4fd3fcb-a30c-4a3e-a187-66d27ad7b194 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:16.401405 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b4fd3fcb-a30c-4a3e-a187-66d27ad7b194 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:16.401405 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b4fd3fcb-a30c-4a3e-a187-66d27ad7b194 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:16.401405 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b4fd3fcb-a30c-4a3e-a187-66d27ad7b194 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:16.438043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1e864fa8-edfe-4bac-a890-f4a45bf7dd3b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:16.438769 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1e864fa8-edfe-4bac-a890-f4a45bf7dd3b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:16.445878 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1e864fa8-edfe-4bac-a890-f4a45bf7dd3b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:16.446420 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1e864fa8-edfe-4bac-a890-f4a45bf7dd3b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:16.447260 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1e864fa8-edfe-4bac-a890-f4a45bf7dd3b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:16.447767 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1e864fa8-edfe-4bac-a890-f4a45bf7dd3b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:16.594122 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1e864fa8-edfe-4bac-a890-f4a45bf7dd3b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:16.604174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1e864fa8-edfe-4bac-a890-f4a45bf7dd3b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.169524 Jul 18 16:58:16.604768 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 408/821] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:16 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:16.609730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-41b9f08c-617b-49de-9203-d38c183264d3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:16.610419 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-41b9f08c-617b-49de-9203-d38c183264d3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:16.618105 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41b9f08c-617b-49de-9203-d38c183264d3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:16.618572 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41b9f08c-617b-49de-9203-d38c183264d3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:16.619406 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41b9f08c-617b-49de-9203-d38c183264d3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:16.619907 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41b9f08c-617b-49de-9203-d38c183264d3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:16.624629 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:16.632814 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b4fd3fcb-a30c-4a3e-a187-66d27ad7b194 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:16.641351 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b4fd3fcb-a30c-4a3e-a187-66d27ad7b194 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1677 microversion: 2.1 time: 0.256076 Jul 18 16:58:16.642158 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 414/822] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:16 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1677 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:16.685845 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-41b9f08c-617b-49de-9203-d38c183264d3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:16.695559 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-41b9f08c-617b-49de-9203-d38c183264d3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:16.697097 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-41b9f08c-617b-49de-9203-d38c183264d3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:16.698287 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-41b9f08c-617b-49de-9203-d38c183264d3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1285 microversion: 2.20 time: 0.092560 Jul 18 16:58:16.699644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 409/823] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:16 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:16.700807 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-071c5307-f5dc-4f14-bc47-c6303947cb3c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:16.701461 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-071c5307-f5dc-4f14-bc47-c6303947cb3c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:16.707939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-071c5307-f5dc-4f14-bc47-c6303947cb3c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:16.708400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-071c5307-f5dc-4f14-bc47-c6303947cb3c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:16.709470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-071c5307-f5dc-4f14-bc47-c6303947cb3c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:16.709914 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-071c5307-f5dc-4f14-bc47-c6303947cb3c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:16.724020 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-071c5307-f5dc-4f14-bc47-c6303947cb3c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-071c5307-f5dc-4f14-bc47-c6303947cb3c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 HTTP/1.1 Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:58:16.725769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:58:16.727075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:58:16.727075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 16:58:16.727075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 16:58:16.727075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 16:58:16.727075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 16:58:16.727075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:58:16.727075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:58:16.727075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 16:58:16.727075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 16:58:16.727075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 16:58:16.727075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 16:58:16.727075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '0a961f74-97c0-4862-a288-ff06a9aa55e9'} Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:58:16.727809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 16:58:16.728975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:16.730129 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-071c5307-f5dc-4f14-bc47-c6303947cb3c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 404 to user: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:58:16.730129 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-071c5307-f5dc-4f14-bc47-c6303947cb3c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 404 len: 111 microversion: 2.1 time: 0.030643 Jul 18 16:58:16.730129 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 415/824] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:16 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:58:16.736737 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-987f6800-e37e-431f-a3c1-3d348962c7ba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '.version_select at 0x7f4af1433ca0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:16.839871 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-987f6800-e37e-431f-a3c1-3d348962c7ba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149494143" status: 202 len: 0 microversion: 2.1 time: 0.107151 Jul 18 16:58:16.840450 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 410/825] 10.222.0.76 () {58 vars in 1220 bytes} [Mon Jul 18 16:58:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149494143 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:58:17.625529 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6f4089c3-38e3-4784-b2d2-6b37a65546a9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:17.626376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6f4089c3-38e3-4784-b2d2-6b37a65546a9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:17.633435 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f4089c3-38e3-4784-b2d2-6b37a65546a9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:17.635213 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f4089c3-38e3-4784-b2d2-6b37a65546a9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:17.635213 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f4089c3-38e3-4784-b2d2-6b37a65546a9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:17.635592 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f4089c3-38e3-4784-b2d2-6b37a65546a9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:17.661383 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d1492ba3-b5f8-4ad2-9c38-035ac54811f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:17.663513 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d1492ba3-b5f8-4ad2-9c38-035ac54811f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:17.671124 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d1492ba3-b5f8-4ad2-9c38-035ac54811f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:17.671860 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d1492ba3-b5f8-4ad2-9c38-035ac54811f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:17.672802 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d1492ba3-b5f8-4ad2-9c38-035ac54811f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:17.673410 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d1492ba3-b5f8-4ad2-9c38-035ac54811f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:17.826384 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d1492ba3-b5f8-4ad2-9c38-035ac54811f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:17.835589 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d1492ba3-b5f8-4ad2-9c38-035ac54811f7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1677 microversion: 2.1 time: 0.178494 Jul 18 16:58:17.836272 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 411/826] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:17 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:17.843475 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-96aa0f2f-d29a-4fdb-87c0-0eb9d2fb18c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:17.844371 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-96aa0f2f-d29a-4fdb-87c0-0eb9d2fb18c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:17.851966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96aa0f2f-d29a-4fdb-87c0-0eb9d2fb18c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:17.852513 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96aa0f2f-d29a-4fdb-87c0-0eb9d2fb18c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:17.853702 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96aa0f2f-d29a-4fdb-87c0-0eb9d2fb18c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:17.854215 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96aa0f2f-d29a-4fdb-87c0-0eb9d2fb18c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:17.890276 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6f4089c3-38e3-4784-b2d2-6b37a65546a9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:17.901583 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6f4089c3-38e3-4784-b2d2-6b37a65546a9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.280011 Jul 18 16:58:17.902470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 416/827] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:17 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:17.956605 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-96aa0f2f-d29a-4fdb-87c0-0eb9d2fb18c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:17.967029 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-96aa0f2f-d29a-4fdb-87c0-0eb9d2fb18c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:17.968841 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-96aa0f2f-d29a-4fdb-87c0-0eb9d2fb18c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:17.969729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-96aa0f2f-d29a-4fdb-87c0-0eb9d2fb18c0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1277 microversion: 2.20 time: 0.132147 Jul 18 16:58:17.970611 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 412/828] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:17 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1277 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:18.035315 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8cc622a8-53c7-42f5-a771-bc070a0e16d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:18.035871 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8cc622a8-53c7-42f5-a771-bc070a0e16d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:18.042576 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8cc622a8-53c7-42f5-a771-bc070a0e16d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:18.043028 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8cc622a8-53c7-42f5-a771-bc070a0e16d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:18.043796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8cc622a8-53c7-42f5-a771-bc070a0e16d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:18.044232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8cc622a8-53c7-42f5-a771-bc070a0e16d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:18.131120 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-8cc622a8-53c7-42f5-a771-bc070a0e16d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lazy-loading 'services' on Instance uuid b57c0d06-7394-47d2-ab8b-2445e996c9bd {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:18.343110 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-7f43e0ea-24d0-4edd-a450-944a23f3dd67 req-85368fcf-5493-44c8-b184-ae680c62c8ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59d02fb-6042-4f0e-a98a-38c41602027a", "tag": "b1ef0b33-c13f-4547-a433-408579d14c01"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:18.351861 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-7f43e0ea-24d0-4edd-a450-944a23f3dd67 req-85368fcf-5493-44c8-b184-ae680c62c8ad service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:18.352325 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-7f43e0ea-24d0-4edd-a450-944a23f3dd67 req-85368fcf-5493-44c8-b184-ae680c62c8ad service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:18.364461 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-7f43e0ea-24d0-4edd-a450-944a23f3dd67 req-85368fcf-5493-44c8-b184-ae680c62c8ad service nova] Creating event network-changed:b1ef0b33-c13f-4547-a433-408579d14c01 for instance e59d02fb-6042-4f0e-a98a-38c41602027a on hv-cinder-83754 Jul 18 16:58:18.370060 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-7f43e0ea-24d0-4edd-a450-944a23f3dd67 req-85368fcf-5493-44c8-b184-ae680c62c8ad service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035779 Jul 18 16:58:18.370734 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 413/829] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:18.445737 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8cc622a8-53c7-42f5-a771-bc070a0e16d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-volume_attachments/48968069-af81-48e8-ab60-6562f51bb0bd" status: 202 len: 0 microversion: 2.1 time: 0.414158 Jul 18 16:58:18.450058 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 417/830] 10.222.0.76 () {58 vars in 1415 bytes} [Mon Jul 18 16:58:18 2022] DELETE /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-volume_attachments/48968069-af81-48e8-ab60-6562f51bb0bd => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:58:18.456179 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-90468e84-b0e1-4c17-b37b-bacc50338fbf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:18.457124 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-90468e84-b0e1-4c17-b37b-bacc50338fbf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:18.465232 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-90468e84-b0e1-4c17-b37b-bacc50338fbf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:18.465692 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-90468e84-b0e1-4c17-b37b-bacc50338fbf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:18.466944 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-90468e84-b0e1-4c17-b37b-bacc50338fbf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:18.467387 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-90468e84-b0e1-4c17-b37b-bacc50338fbf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:18.507062 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-90468e84-b0e1-4c17-b37b-bacc50338fbf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055280 Jul 18 16:58:18.508338 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 414/831] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 16:58:18 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:18.853224 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f13aae57-1b78-43d8-8caa-7eb63892bfcb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:18.854647 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f13aae57-1b78-43d8-8caa-7eb63892bfcb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:18.862995 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f13aae57-1b78-43d8-8caa-7eb63892bfcb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:18.863595 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f13aae57-1b78-43d8-8caa-7eb63892bfcb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:18.864479 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f13aae57-1b78-43d8-8caa-7eb63892bfcb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:18.865593 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f13aae57-1b78-43d8-8caa-7eb63892bfcb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:18.878727 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-98db70fe-62aa-4200-95c4-0be7c7f9c752 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:18.880347 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-98db70fe-62aa-4200-95c4-0be7c7f9c752 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:18.888964 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-98db70fe-62aa-4200-95c4-0be7c7f9c752 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:18.890080 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-98db70fe-62aa-4200-95c4-0be7c7f9c752 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:18.891067 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-98db70fe-62aa-4200-95c4-0be7c7f9c752 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:18.891562 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-98db70fe-62aa-4200-95c4-0be7c7f9c752 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:19.017580 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f13aae57-1b78-43d8-8caa-7eb63892bfcb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:19.026207 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f13aae57-1b78-43d8-8caa-7eb63892bfcb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1677 microversion: 2.1 time: 0.177741 Jul 18 16:58:19.026777 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 418/832] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:18 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:19.031879 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4b198a3a-2992-4f6b-9df1-3489a2f50419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:19.032685 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4b198a3a-2992-4f6b-9df1-3489a2f50419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:19.040309 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4b198a3a-2992-4f6b-9df1-3489a2f50419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:19.040752 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4b198a3a-2992-4f6b-9df1-3489a2f50419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:19.041565 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4b198a3a-2992-4f6b-9df1-3489a2f50419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:19.041998 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4b198a3a-2992-4f6b-9df1-3489a2f50419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:19.118349 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-98db70fe-62aa-4200-95c4-0be7c7f9c752 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "POST /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/action" status: 202 len: 0 microversion: 2.1 time: 0.243524 Jul 18 16:58:19.119914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 415/833] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 16:58:18 2022] POST /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:58:19.125900 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-de3837d7-92f6-42f5-9f42-7f55817397d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:19.130757 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-de3837d7-92f6-42f5-9f42-7f55817397d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:19.134307 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de3837d7-92f6-42f5-9f42-7f55817397d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:19.134880 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de3837d7-92f6-42f5-9f42-7f55817397d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:19.135758 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de3837d7-92f6-42f5-9f42-7f55817397d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:19.136290 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de3837d7-92f6-42f5-9f42-7f55817397d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:19.197240 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4b198a3a-2992-4f6b-9df1-3489a2f50419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:19.205783 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4b198a3a-2992-4f6b-9df1-3489a2f50419 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.177422 Jul 18 16:58:19.206376 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 419/834] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:19 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:19.207720 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-de3837d7-92f6-42f5-9f42-7f55817397d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:19.217535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-de3837d7-92f6-42f5-9f42-7f55817397d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:19.219071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-de3837d7-92f6-42f5-9f42-7f55817397d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:19.220150 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a74f1751-7fd2-4210-bc0a-2bedf7782b76 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:19.220299 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-de3837d7-92f6-42f5-9f42-7f55817397d7 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1351 microversion: 2.20 time: 0.098882 Jul 18 16:58:19.220777 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 416/835] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:19 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:19.221355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a74f1751-7fd2-4210-bc0a-2bedf7782b76 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:19.228570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a74f1751-7fd2-4210-bc0a-2bedf7782b76 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:19.229059 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a74f1751-7fd2-4210-bc0a-2bedf7782b76 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:19.229968 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a74f1751-7fd2-4210-bc0a-2bedf7782b76 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:19.230409 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a74f1751-7fd2-4210-bc0a-2bedf7782b76 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:19.426621 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a74f1751-7fd2-4210-bc0a-2bedf7782b76 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:19.435045 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a74f1751-7fd2-4210-bc0a-2bedf7782b76 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1752 microversion: 2.1 time: 0.220743 Jul 18 16:58:19.435599 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 420/836] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:19 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1752 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:19.520925 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-adfd986e-cf22-40c6-bcf4-6ab7f68cb910 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:19.522226 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-adfd986e-cf22-40c6-bcf4-6ab7f68cb910 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:19.534795 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-adfd986e-cf22-40c6-bcf4-6ab7f68cb910 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:19.534795 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-adfd986e-cf22-40c6-bcf4-6ab7f68cb910 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:19.534795 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-adfd986e-cf22-40c6-bcf4-6ab7f68cb910 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:19.534795 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-adfd986e-cf22-40c6-bcf4-6ab7f68cb910 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:19.573761 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-adfd986e-cf22-40c6-bcf4-6ab7f68cb910 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058167 Jul 18 16:58:19.578015 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 417/837] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 16:58:19 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:20.043995 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-972966cb-5a2a-47bc-8f59-a361d45a6e92 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:20.045072 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-972966cb-5a2a-47bc-8f59-a361d45a6e92 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:20.053289 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-972966cb-5a2a-47bc-8f59-a361d45a6e92 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:20.055240 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-972966cb-5a2a-47bc-8f59-a361d45a6e92 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:20.056186 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-972966cb-5a2a-47bc-8f59-a361d45a6e92 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:20.056880 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-972966cb-5a2a-47bc-8f59-a361d45a6e92 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:20.224036 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5ea0a120-368b-40de-a819-634e4eec7e61 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:20.225371 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5ea0a120-368b-40de-a819-634e4eec7e61 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:20.232334 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5ea0a120-368b-40de-a819-634e4eec7e61 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:20.232786 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5ea0a120-368b-40de-a819-634e4eec7e61 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:20.233811 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5ea0a120-368b-40de-a819-634e4eec7e61 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:20.234328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5ea0a120-368b-40de-a819-634e4eec7e61 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:20.389971 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5ea0a120-368b-40de-a819-634e4eec7e61 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:20.399027 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5ea0a120-368b-40de-a819-634e4eec7e61 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.178866 Jul 18 16:58:20.399617 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 418/838] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:20 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:20.404378 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-11d50cc8-2dfe-4117-9120-32554832bfea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:20.404981 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-11d50cc8-2dfe-4117-9120-32554832bfea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:20.411029 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-11d50cc8-2dfe-4117-9120-32554832bfea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:20.411478 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-11d50cc8-2dfe-4117-9120-32554832bfea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:20.412909 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-11d50cc8-2dfe-4117-9120-32554832bfea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:20.413375 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-11d50cc8-2dfe-4117-9120-32554832bfea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:20.424443 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-972966cb-5a2a-47bc-8f59-a361d45a6e92 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:20.433478 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-972966cb-5a2a-47bc-8f59-a361d45a6e92 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1677 microversion: 2.1 time: 0.393327 Jul 18 16:58:20.444106 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 421/839] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:20 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1677 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:20.453894 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ad5c2598-d8ed-4d45-8df0-a04b5e428cb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:20.455047 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ad5c2598-d8ed-4d45-8df0-a04b5e428cb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:20.462983 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad5c2598-d8ed-4d45-8df0-a04b5e428cb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:20.463446 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad5c2598-d8ed-4d45-8df0-a04b5e428cb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:20.464608 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad5c2598-d8ed-4d45-8df0-a04b5e428cb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:20.464987 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad5c2598-d8ed-4d45-8df0-a04b5e428cb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:20.507674 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-11d50cc8-2dfe-4117-9120-32554832bfea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:20.520294 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-11d50cc8-2dfe-4117-9120-32554832bfea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:20.522501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-11d50cc8-2dfe-4117-9120-32554832bfea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:20.523622 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-11d50cc8-2dfe-4117-9120-32554832bfea tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1339 microversion: 2.20 time: 0.122902 Jul 18 16:58:20.524184 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 419/840] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:20 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1339 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:20.594640 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-26d1c9b2-78ec-4ba0-a647-4f63fd7a9009 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:20.597091 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-26d1c9b2-78ec-4ba0-a647-4f63fd7a9009 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:20.606658 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26d1c9b2-78ec-4ba0-a647-4f63fd7a9009 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:20.607905 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26d1c9b2-78ec-4ba0-a647-4f63fd7a9009 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:20.608868 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26d1c9b2-78ec-4ba0-a647-4f63fd7a9009 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:20.610284 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26d1c9b2-78ec-4ba0-a647-4f63fd7a9009 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:20.663866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-26d1c9b2-78ec-4ba0-a647-4f63fd7a9009 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073251 Jul 18 16:58:20.666839 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 420/841] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 16:58:20 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:58:20.769707 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ad5c2598-d8ed-4d45-8df0-a04b5e428cb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:20.786352 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ad5c2598-d8ed-4d45-8df0-a04b5e428cb0 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1752 microversion: 2.1 time: 0.337752 Jul 18 16:58:20.787622 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 422/842] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:20 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1752 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:21.418853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fff7cb7c-2939-488e-9658-e6afdfe0909e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:21.420321 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fff7cb7c-2939-488e-9658-e6afdfe0909e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:21.429115 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fff7cb7c-2939-488e-9658-e6afdfe0909e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.429656 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fff7cb7c-2939-488e-9658-e6afdfe0909e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.430745 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fff7cb7c-2939-488e-9658-e6afdfe0909e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.431533 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fff7cb7c-2939-488e-9658-e6afdfe0909e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.451939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7d0ac142-7fda-4b93-9c84-cb54e715844d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:21.452747 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7d0ac142-7fda-4b93-9c84-cb54e715844d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:21.460644 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7d0ac142-7fda-4b93-9c84-cb54e715844d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.461745 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7d0ac142-7fda-4b93-9c84-cb54e715844d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.462786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7d0ac142-7fda-4b93-9c84-cb54e715844d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.463435 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7d0ac142-7fda-4b93-9c84-cb54e715844d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.629767 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7d0ac142-7fda-4b93-9c84-cb54e715844d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:21.639324 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fff7cb7c-2939-488e-9658-e6afdfe0909e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:21.643874 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7d0ac142-7fda-4b93-9c84-cb54e715844d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1677 microversion: 2.1 time: 0.196150 Jul 18 16:58:21.645000 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 423/843] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:21 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:21.652327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4284ea3e-4226-47ab-8ca8-9a3497ee9a81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:21.652327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4284ea3e-4226-47ab-8ca8-9a3497ee9a81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:21.657599 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fff7cb7c-2939-488e-9658-e6afdfe0909e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.242352 Jul 18 16:58:21.659278 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 421/844] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:21 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:21.659760 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4284ea3e-4226-47ab-8ca8-9a3497ee9a81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.660215 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4284ea3e-4226-47ab-8ca8-9a3497ee9a81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.661266 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4284ea3e-4226-47ab-8ca8-9a3497ee9a81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.661715 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4284ea3e-4226-47ab-8ca8-9a3497ee9a81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.673304 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f9176a5c-fac3-41c4-98ee-d4824499a1c7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:21.674236 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f9176a5c-fac3-41c4-98ee-d4824499a1c7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:21.695113 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f9176a5c-fac3-41c4-98ee-d4824499a1c7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.696133 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f9176a5c-fac3-41c4-98ee-d4824499a1c7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.696966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f9176a5c-fac3-41c4-98ee-d4824499a1c7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.697661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f9176a5c-fac3-41c4-98ee-d4824499a1c7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.702618 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:21.729678 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f9176a5c-fac3-41c4-98ee-d4824499a1c7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060423 Jul 18 16:58:21.738748 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 422/845] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 16:58:21 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:58:21.793586 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-daaf0eed-0dc5-47bf-ab38-ad15f75cf868 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:21.799002 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-daaf0eed-0dc5-47bf-ab38-ad15f75cf868 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:21.801530 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-daaf0eed-0dc5-47bf-ab38-ad15f75cf868 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.803350 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-daaf0eed-0dc5-47bf-ab38-ad15f75cf868 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.804299 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-daaf0eed-0dc5-47bf-ab38-ad15f75cf868 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.804769 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-daaf0eed-0dc5-47bf-ab38-ad15f75cf868 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.829899 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4284ea3e-4226-47ab-8ca8-9a3497ee9a81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:21.832235 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-daaf0eed-0dc5-47bf-ab38-ad15f75cf868 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:58:21.838362 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4284ea3e-4226-47ab-8ca8-9a3497ee9a81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:21.839880 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4284ea3e-4226-47ab-8ca8-9a3497ee9a81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:21.841066 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4284ea3e-4226-47ab-8ca8-9a3497ee9a81 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.194884 Jul 18 16:58:21.841649 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 424/846] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:21 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:21.846202 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9ab5aa74-09d2-4804-8de4-74921fed5059 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:21.846704 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9ab5aa74-09d2-4804-8de4-74921fed5059 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:21.854321 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ab5aa74-09d2-4804-8de4-74921fed5059 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.854776 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ab5aa74-09d2-4804-8de4-74921fed5059 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.855561 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ab5aa74-09d2-4804-8de4-74921fed5059 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.856007 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ab5aa74-09d2-4804-8de4-74921fed5059 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.963004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-9ab5aa74-09d2-4804-8de4-74921fed5059 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lazy-loading 'services' on Instance uuid 10246df8-f808-47a9-947f-af78a2fd64c9 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:22.267190 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-daaf0eed-0dc5-47bf-ab38-ad15f75cf868 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 204 len: 0 microversion: 2.1 time: 0.477604 Jul 18 16:58:22.268486 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 423/847] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 16:58:21 2022] DELETE /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:58:22.273763 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dffe9f8c-0c07-42d8-9b3f-8d73d45ec686 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:22.274831 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dffe9f8c-0c07-42d8-9b3f-8d73d45ec686 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:22.275255 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9ab5aa74-09d2-4804-8de4-74921fed5059 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "DELETE /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments/b925ab20-5c59-4b2d-9819-65db70036e52" status: 202 len: 0 microversion: 2.1 time: 0.430330 Jul 18 16:58:22.278911 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 425/848] 10.222.0.76 () {58 vars in 1415 bytes} [Mon Jul 18 16:58:21 2022] DELETE /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments/b925ab20-5c59-4b2d-9819-65db70036e52 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:58:22.282141 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dffe9f8c-0c07-42d8-9b3f-8d73d45ec686 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.282658 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dffe9f8c-0c07-42d8-9b3f-8d73d45ec686 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.283605 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dffe9f8c-0c07-42d8-9b3f-8d73d45ec686 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.284051 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dffe9f8c-0c07-42d8-9b3f-8d73d45ec686 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.284721 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-2aa2c279-0e67-4c05-9d70-8198c298841f req-dc93d7da-2af4-498e-891d-a2f10a2692a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55db823-1c00-4ca0-bc6f-cd070459c5e9", "tag": "2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:22.293919 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-2aa2c279-0e67-4c05-9d70-8198c298841f req-dc93d7da-2af4-498e-891d-a2f10a2692a5 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.294365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-2aa2c279-0e67-4c05-9d70-8198c298841f req-dc93d7da-2af4-498e-891d-a2f10a2692a5 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.305844 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-2aa2c279-0e67-4c05-9d70-8198c298841f req-dc93d7da-2af4-498e-891d-a2f10a2692a5 service nova] Creating event network-changed:2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662 for instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 on hv-cinder-83754 Jul 18 16:58:22.310631 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-2aa2c279-0e67-4c05-9d70-8198c298841f req-dc93d7da-2af4-498e-891d-a2f10a2692a5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030179 Jul 18 16:58:22.311573 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 426/849] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:22.316755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-082a27b8-4cd2-4ce3-973e-5f55f9a6fda0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:22.318357 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-082a27b8-4cd2-4ce3-973e-5f55f9a6fda0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:22.326527 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-082a27b8-4cd2-4ce3-973e-5f55f9a6fda0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.327118 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-082a27b8-4cd2-4ce3-973e-5f55f9a6fda0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.328021 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-082a27b8-4cd2-4ce3-973e-5f55f9a6fda0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.328583 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-082a27b8-4cd2-4ce3-973e-5f55f9a6fda0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.440341 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dffe9f8c-0c07-42d8-9b3f-8d73d45ec686 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:22.444019 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:22.449260 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dffe9f8c-0c07-42d8-9b3f-8d73d45ec686 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1757 microversion: 2.1 time: 0.179820 Jul 18 16:58:22.449840 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 424/850] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:22 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:22.454855 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-63361211-4253-45b3-9190-962b730a4896 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:22.456716 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-63361211-4253-45b3-9190-962b730a4896 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:22.463466 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-63361211-4253-45b3-9190-962b730a4896 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.463997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-63361211-4253-45b3-9190-962b730a4896 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.464772 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-63361211-4253-45b3-9190-962b730a4896 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.465313 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-63361211-4253-45b3-9190-962b730a4896 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.473963 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-082a27b8-4cd2-4ce3-973e-5f55f9a6fda0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:22.482220 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-082a27b8-4cd2-4ce3-973e-5f55f9a6fda0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1680 microversion: 2.1 time: 0.169503 Jul 18 16:58:22.482786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 427/851] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:22 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:22.496807 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-63361211-4253-45b3-9190-962b730a4896 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045931 Jul 18 16:58:22.497457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 425/852] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 16:58:22 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:22.663628 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fe63a919-7548-4809-83bb-3fcce817dc74 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:22.664128 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fe63a919-7548-4809-83bb-3fcce817dc74 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:22.670145 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe63a919-7548-4809-83bb-3fcce817dc74 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.670597 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe63a919-7548-4809-83bb-3fcce817dc74 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.671362 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe63a919-7548-4809-83bb-3fcce817dc74 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.671794 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe63a919-7548-4809-83bb-3fcce817dc74 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.676360 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-63891c61-bf23-49d4-b8ec-ee2089001b11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:22.676975 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-63891c61-bf23-49d4-b8ec-ee2089001b11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:22.683958 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-63891c61-bf23-49d4-b8ec-ee2089001b11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.684402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-63891c61-bf23-49d4-b8ec-ee2089001b11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.685212 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-63891c61-bf23-49d4-b8ec-ee2089001b11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.685648 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-63891c61-bf23-49d4-b8ec-ee2089001b11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.814400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fe63a919-7548-4809-83bb-3fcce817dc74 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:22.822381 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fe63a919-7548-4809-83bb-3fcce817dc74 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1677 microversion: 2.1 time: 0.162905 Jul 18 16:58:22.825110 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 428/853] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:22 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:22.852662 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-63891c61-bf23-49d4-b8ec-ee2089001b11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:22.859729 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-353cbec8-0677-4857-965d-3398342c64fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:22.860583 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-353cbec8-0677-4857-965d-3398342c64fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:22.861132 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-63891c61-bf23-49d4-b8ec-ee2089001b11 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.188851 Jul 18 16:58:22.862147 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 426/854] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:22 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:22.867986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-353cbec8-0677-4857-965d-3398342c64fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.868508 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-353cbec8-0677-4857-965d-3398342c64fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.869377 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-353cbec8-0677-4857-965d-3398342c64fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.869878 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-353cbec8-0677-4857-965d-3398342c64fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.889001 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:23.011206 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-353cbec8-0677-4857-965d-3398342c64fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:23.020013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-353cbec8-0677-4857-965d-3398342c64fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:23.021648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-353cbec8-0677-4857-965d-3398342c64fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:23.022815 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-353cbec8-0677-4857-965d-3398342c64fa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.167133 Jul 18 16:58:23.023438 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 429/855] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:22 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:23.467180 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e269cdd2-1211-4429-a95b-6fbb52096bd4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:23.467791 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e269cdd2-1211-4429-a95b-6fbb52096bd4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:23.474346 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e269cdd2-1211-4429-a95b-6fbb52096bd4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.475550 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e269cdd2-1211-4429-a95b-6fbb52096bd4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.476318 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e269cdd2-1211-4429-a95b-6fbb52096bd4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.476753 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e269cdd2-1211-4429-a95b-6fbb52096bd4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.499870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5068fb98-60ed-49e4-a8d3-2cb123f52db8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:23.500480 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5068fb98-60ed-49e4-a8d3-2cb123f52db8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:23.508602 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5068fb98-60ed-49e4-a8d3-2cb123f52db8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.509089 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5068fb98-60ed-49e4-a8d3-2cb123f52db8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.510047 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5068fb98-60ed-49e4-a8d3-2cb123f52db8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.510547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5068fb98-60ed-49e4-a8d3-2cb123f52db8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.625140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e269cdd2-1211-4429-a95b-6fbb52096bd4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:23.634063 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e269cdd2-1211-4429-a95b-6fbb52096bd4 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1757 microversion: 2.1 time: 0.170622 Jul 18 16:58:23.644317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 427/856] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:23 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:23.644317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6b512388-1c7c-4243-8251-96e98ed598ea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:23.644317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6b512388-1c7c-4243-8251-96e98ed598ea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:23.651214 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b512388-1c7c-4243-8251-96e98ed598ea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.651901 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b512388-1c7c-4243-8251-96e98ed598ea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.652446 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b512388-1c7c-4243-8251-96e98ed598ea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.652881 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b512388-1c7c-4243-8251-96e98ed598ea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.660465 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5068fb98-60ed-49e4-a8d3-2cb123f52db8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:23.665129 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5068fb98-60ed-49e4-a8d3-2cb123f52db8 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1680 microversion: 2.1 time: 0.169010 Jul 18 16:58:23.673078 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 430/857] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:23 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:23.683759 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6b512388-1c7c-4243-8251-96e98ed598ea tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048081 Jul 18 16:58:23.689294 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 428/858] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 16:58:23 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:23.840594 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-53226733-a3f7-4f31-ba1b-74ca933798e6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:23.841234 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-53226733-a3f7-4f31-ba1b-74ca933798e6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:23.847307 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-53226733-a3f7-4f31-ba1b-74ca933798e6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.847750 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-53226733-a3f7-4f31-ba1b-74ca933798e6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.848644 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-53226733-a3f7-4f31-ba1b-74ca933798e6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.849145 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-53226733-a3f7-4f31-ba1b-74ca933798e6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.879855 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-87d8788a-7284-4c28-9d6b-3b82c52881e9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:23.881172 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-87d8788a-7284-4c28-9d6b-3b82c52881e9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:23.887290 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87d8788a-7284-4c28-9d6b-3b82c52881e9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.887735 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87d8788a-7284-4c28-9d6b-3b82c52881e9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.888512 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87d8788a-7284-4c28-9d6b-3b82c52881e9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.888953 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87d8788a-7284-4c28-9d6b-3b82c52881e9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.988150 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-53226733-a3f7-4f31-ba1b-74ca933798e6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:23.996545 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-53226733-a3f7-4f31-ba1b-74ca933798e6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1677 microversion: 2.1 time: 0.159901 Jul 18 16:58:23.997158 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 431/859] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:23 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:24.024018 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-87d8788a-7284-4c28-9d6b-3b82c52881e9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:24.031557 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-87d8788a-7284-4c28-9d6b-3b82c52881e9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.155625 Jul 18 16:58:24.032126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 429/860] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:23 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:24.040966 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ab61ecf5-3bae-4047-b7fb-b5caf7dab604 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:24.041612 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ab61ecf5-3bae-4047-b7fb-b5caf7dab604 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:24.048048 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ab61ecf5-3bae-4047-b7fb-b5caf7dab604 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:24.048495 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ab61ecf5-3bae-4047-b7fb-b5caf7dab604 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:24.049328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ab61ecf5-3bae-4047-b7fb-b5caf7dab604 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:24.049767 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ab61ecf5-3bae-4047-b7fb-b5caf7dab604 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:24.184949 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ab61ecf5-3bae-4047-b7fb-b5caf7dab604 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:24.193869 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ab61ecf5-3bae-4047-b7fb-b5caf7dab604 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:24.195243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ab61ecf5-3bae-4047-b7fb-b5caf7dab604 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:24.196395 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ab61ecf5-3bae-4047-b7fb-b5caf7dab604 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.159558 Jul 18 16:58:24.196946 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 432/861] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:24 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:24.654950 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ed9ffd3c-646e-419a-9b3d-c5955182db1d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:24.655579 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ed9ffd3c-646e-419a-9b3d-c5955182db1d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:24.657460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=8 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:24.663459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed9ffd3c-646e-419a-9b3d-c5955182db1d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:24.663979 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed9ffd3c-646e-419a-9b3d-c5955182db1d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:24.677667 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed9ffd3c-646e-419a-9b3d-c5955182db1d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:24.677667 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed9ffd3c-646e-419a-9b3d-c5955182db1d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:24.682587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c1b46082-122d-49e3-9f1e-cc5e74e1edc6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:24.683355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c1b46082-122d-49e3-9f1e-cc5e74e1edc6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:24.689967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c1b46082-122d-49e3-9f1e-cc5e74e1edc6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:24.690427 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c1b46082-122d-49e3-9f1e-cc5e74e1edc6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:24.691205 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c1b46082-122d-49e3-9f1e-cc5e74e1edc6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:24.691650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c1b46082-122d-49e3-9f1e-cc5e74e1edc6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:24.819711 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ed9ffd3c-646e-419a-9b3d-c5955182db1d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:24.828294 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ed9ffd3c-646e-419a-9b3d-c5955182db1d tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1757 microversion: 2.1 time: 0.177241 Jul 18 16:58:24.828864 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 430/862] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:24 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:24.832357 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c1b46082-122d-49e3-9f1e-cc5e74e1edc6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:24.840455 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9db65e90-bc8d-4160-8654-14efced9ca87 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:24.841174 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c1b46082-122d-49e3-9f1e-cc5e74e1edc6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1680 microversion: 2.1 time: 0.162468 Jul 18 16:58:24.841435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9db65e90-bc8d-4160-8654-14efced9ca87 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:24.841738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 433/863] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:24 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:24.847487 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9db65e90-bc8d-4160-8654-14efced9ca87 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:24.849881 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9db65e90-bc8d-4160-8654-14efced9ca87 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:24.849881 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9db65e90-bc8d-4160-8654-14efced9ca87 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:24.849881 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9db65e90-bc8d-4160-8654-14efced9ca87 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:24.878671 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9db65e90-bc8d-4160-8654-14efced9ca87 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043469 Jul 18 16:58:24.879230 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 431/864] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 16:58:24 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:25.014626 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ef88a7b1-ca2e-4cfb-85b6-49995f166fa1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:25.015243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ef88a7b1-ca2e-4cfb-85b6-49995f166fa1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:25.022331 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef88a7b1-ca2e-4cfb-85b6-49995f166fa1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:25.022728 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef88a7b1-ca2e-4cfb-85b6-49995f166fa1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:25.023503 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef88a7b1-ca2e-4cfb-85b6-49995f166fa1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:25.023948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef88a7b1-ca2e-4cfb-85b6-49995f166fa1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:25.047601 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8e56909e-e1f1-4d63-8172-9f9ffea663f6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:25.048209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8e56909e-e1f1-4d63-8172-9f9ffea663f6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:25.054593 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e56909e-e1f1-4d63-8172-9f9ffea663f6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:25.054999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e56909e-e1f1-4d63-8172-9f9ffea663f6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:25.055772 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e56909e-e1f1-4d63-8172-9f9ffea663f6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:25.056288 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e56909e-e1f1-4d63-8172-9f9ffea663f6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:25.159784 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ef88a7b1-ca2e-4cfb-85b6-49995f166fa1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:25.168280 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ef88a7b1-ca2e-4cfb-85b6-49995f166fa1 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1677 microversion: 2.1 time: 0.157646 Jul 18 16:58:25.171965 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 434/865] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:25 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:25.197367 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8e56909e-e1f1-4d63-8172-9f9ffea663f6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:25.204809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8e56909e-e1f1-4d63-8172-9f9ffea663f6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.161075 Jul 18 16:58:25.205401 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 432/866] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:25 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:25.214440 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ba188e74-5ed0-4182-ab10-aa4971eaff17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:25.215048 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ba188e74-5ed0-4182-ab10-aa4971eaff17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:25.221195 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba188e74-5ed0-4182-ab10-aa4971eaff17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:25.221688 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba188e74-5ed0-4182-ab10-aa4971eaff17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:25.222459 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba188e74-5ed0-4182-ab10-aa4971eaff17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:25.222903 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba188e74-5ed0-4182-ab10-aa4971eaff17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:25.353823 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ba188e74-5ed0-4182-ab10-aa4971eaff17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:25.361988 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ba188e74-5ed0-4182-ab10-aa4971eaff17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:25.363499 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ba188e74-5ed0-4182-ab10-aa4971eaff17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:25.364609 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ba188e74-5ed0-4182-ab10-aa4971eaff17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.154134 Jul 18 16:58:25.365840 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 435/867] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:25 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:25.846982 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dcadbbc6-a6e1-4bbd-8c9f-b268c66866a5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:25.847590 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dcadbbc6-a6e1-4bbd-8c9f-b268c66866a5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:25.854603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dcadbbc6-a6e1-4bbd-8c9f-b268c66866a5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:25.855054 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dcadbbc6-a6e1-4bbd-8c9f-b268c66866a5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:25.855823 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dcadbbc6-a6e1-4bbd-8c9f-b268c66866a5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:25.856262 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dcadbbc6-a6e1-4bbd-8c9f-b268c66866a5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:25.859419 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5eb332fc-4d6e-499b-b08a-ab21bb3722b6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:25.862343 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5eb332fc-4d6e-499b-b08a-ab21bb3722b6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:25.862343 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=10 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:25.867671 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5eb332fc-4d6e-499b-b08a-ab21bb3722b6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:25.868198 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5eb332fc-4d6e-499b-b08a-ab21bb3722b6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:25.868988 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5eb332fc-4d6e-499b-b08a-ab21bb3722b6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:25.869455 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5eb332fc-4d6e-499b-b08a-ab21bb3722b6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:26.004007 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5eb332fc-4d6e-499b-b08a-ab21bb3722b6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:26.011620 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dcadbbc6-a6e1-4bbd-8c9f-b268c66866a5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:26.012279 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5eb332fc-4d6e-499b-b08a-ab21bb3722b6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1680 microversion: 2.1 time: 0.156749 Jul 18 16:58:26.012861 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 436/868] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:25 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:26.022872 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3f023b17-be66-4e0a-a281-5e2d58bf4c43 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:26.022872 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3f023b17-be66-4e0a-a281-5e2d58bf4c43 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:26.023108 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dcadbbc6-a6e1-4bbd-8c9f-b268c66866a5 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1757 microversion: 2.1 time: 0.176686 Jul 18 16:58:26.023108 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 433/869] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:25 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:26.025201 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3f023b17-be66-4e0a-a281-5e2d58bf4c43 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:26.025656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3f023b17-be66-4e0a-a281-5e2d58bf4c43 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:26.026427 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3f023b17-be66-4e0a-a281-5e2d58bf4c43 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:26.026889 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3f023b17-be66-4e0a-a281-5e2d58bf4c43 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:26.055708 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3f023b17-be66-4e0a-a281-5e2d58bf4c43 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041796 Jul 18 16:58:26.056322 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 437/870] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 16:58:26 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:26.186273 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2a686ffa-575c-4230-9666-9c7ac3e93621 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:26.186876 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2a686ffa-575c-4230-9666-9c7ac3e93621 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:26.193140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2a686ffa-575c-4230-9666-9c7ac3e93621 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:26.193537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2a686ffa-575c-4230-9666-9c7ac3e93621 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:26.195113 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2a686ffa-575c-4230-9666-9c7ac3e93621 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:26.195542 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2a686ffa-575c-4230-9666-9c7ac3e93621 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:26.221968 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a6953cb6-521a-4a55-9e86-6b8fea790320 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:26.222588 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a6953cb6-521a-4a55-9e86-6b8fea790320 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:26.228866 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a6953cb6-521a-4a55-9e86-6b8fea790320 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:26.229351 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a6953cb6-521a-4a55-9e86-6b8fea790320 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:26.230129 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a6953cb6-521a-4a55-9e86-6b8fea790320 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:26.230633 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a6953cb6-521a-4a55-9e86-6b8fea790320 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:26.329551 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2a686ffa-575c-4230-9666-9c7ac3e93621 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:26.338309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2a686ffa-575c-4230-9666-9c7ac3e93621 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1677 microversion: 2.1 time: 0.155897 Jul 18 16:58:26.338924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 434/871] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:26 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:26.368803 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a6953cb6-521a-4a55-9e86-6b8fea790320 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:26.376437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a6953cb6-521a-4a55-9e86-6b8fea790320 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.158367 Jul 18 16:58:26.377027 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 438/872] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:26 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:26.384274 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d21f842a-6ca8-444f-ab6e-d0c8fe984d72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:26.384886 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d21f842a-6ca8-444f-ab6e-d0c8fe984d72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:26.390954 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d21f842a-6ca8-444f-ab6e-d0c8fe984d72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:26.391404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d21f842a-6ca8-444f-ab6e-d0c8fe984d72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:26.392168 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d21f842a-6ca8-444f-ab6e-d0c8fe984d72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:26.392606 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d21f842a-6ca8-444f-ab6e-d0c8fe984d72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:26.563142 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d21f842a-6ca8-444f-ab6e-d0c8fe984d72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:26.571166 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d21f842a-6ca8-444f-ab6e-d0c8fe984d72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:26.572671 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d21f842a-6ca8-444f-ab6e-d0c8fe984d72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:26.573797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d21f842a-6ca8-444f-ab6e-d0c8fe984d72 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.194259 Jul 18 16:58:26.574358 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 435/873] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:26 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:27.029828 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3093ea4c-943e-405c-a8b4-aa3579f607c0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:27.030425 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3093ea4c-943e-405c-a8b4-aa3579f607c0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:27.037567 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3093ea4c-943e-405c-a8b4-aa3579f607c0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.039419 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bfac3dd7-06af-4c10-a2d3-bf0c6981d9f1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:27.039913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3093ea4c-943e-405c-a8b4-aa3579f607c0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.040186 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bfac3dd7-06af-4c10-a2d3-bf0c6981d9f1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:27.040705 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3093ea4c-943e-405c-a8b4-aa3579f607c0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.041085 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3093ea4c-943e-405c-a8b4-aa3579f607c0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.047026 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bfac3dd7-06af-4c10-a2d3-bf0c6981d9f1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.047421 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bfac3dd7-06af-4c10-a2d3-bf0c6981d9f1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.048211 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bfac3dd7-06af-4c10-a2d3-bf0c6981d9f1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.048795 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bfac3dd7-06af-4c10-a2d3-bf0c6981d9f1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.271946 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3093ea4c-943e-405c-a8b4-aa3579f607c0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:27.280776 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3093ea4c-943e-405c-a8b4-aa3579f607c0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1680 microversion: 2.1 time: 0.254576 Jul 18 16:58:27.291516 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 439/874] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:27 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1680 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:27.296828 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9b647152-25d0-49c2-9f5e-e8409b6d7552 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:27.298118 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9b647152-25d0-49c2-9f5e-e8409b6d7552 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:27.305578 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9b647152-25d0-49c2-9f5e-e8409b6d7552 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.306340 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9b647152-25d0-49c2-9f5e-e8409b6d7552 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.307303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9b647152-25d0-49c2-9f5e-e8409b6d7552 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.307902 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9b647152-25d0-49c2-9f5e-e8409b6d7552 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.350859 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9b647152-25d0-49c2-9f5e-e8409b6d7552 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056425 Jul 18 16:58:27.350859 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 440/875] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 16:58:27 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:27.356845 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-2fe079f4-81b2-4989-a3c3-4f514f00eb32 req-f0e53d73-95ca-4aab-91b3-a7c77fa813e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57c0d06-7394-47d2-ab8b-2445e996c9bd", "name": "network-vif-unplugged", "status": "completed", "tag": "d7caf253-581a-4f92-93cf-cb4bd4b4b2a3"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:27.367922 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-2fe079f4-81b2-4989-a3c3-4f514f00eb32 req-f0e53d73-95ca-4aab-91b3-a7c77fa813e5 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.367922 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-2fe079f4-81b2-4989-a3c3-4f514f00eb32 req-f0e53d73-95ca-4aab-91b3-a7c77fa813e5 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.378777 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-2fe079f4-81b2-4989-a3c3-4f514f00eb32 req-f0e53d73-95ca-4aab-91b3-a7c77fa813e5 service nova] Creating event network-vif-unplugged:d7caf253-581a-4f92-93cf-cb4bd4b4b2a3 for instance b57c0d06-7394-47d2-ab8b-2445e996c9bd on hv-cinder-83754 Jul 18 16:58:27.384784 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-2fe079f4-81b2-4989-a3c3-4f514f00eb32 req-f0e53d73-95ca-4aab-91b3-a7c77fa813e5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032505 Jul 18 16:58:27.385471 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 441/876] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:27.392433 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0afe6e3e-9d06-4d6c-a6ad-7076e21771cd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:27.393346 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0afe6e3e-9d06-4d6c-a6ad-7076e21771cd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:27.403273 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0afe6e3e-9d06-4d6c-a6ad-7076e21771cd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.403273 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0afe6e3e-9d06-4d6c-a6ad-7076e21771cd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.403273 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0afe6e3e-9d06-4d6c-a6ad-7076e21771cd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.403273 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0afe6e3e-9d06-4d6c-a6ad-7076e21771cd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.414712 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bfac3dd7-06af-4c10-a2d3-bf0c6981d9f1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:27.423242 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bfac3dd7-06af-4c10-a2d3-bf0c6981d9f1 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1757 microversion: 2.1 time: 0.389430 Jul 18 16:58:27.423835 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 436/877] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:27 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1757 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:27.429331 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-eaf8954f-f8df-47d5-8506-c25fd368232b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:27.429945 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-eaf8954f-f8df-47d5-8506-c25fd368232b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:27.436249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eaf8954f-f8df-47d5-8506-c25fd368232b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.442573 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eaf8954f-f8df-47d5-8506-c25fd368232b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.442573 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eaf8954f-f8df-47d5-8506-c25fd368232b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.442573 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eaf8954f-f8df-47d5-8506-c25fd368232b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.580961 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0afe6e3e-9d06-4d6c-a6ad-7076e21771cd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:27.590987 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0afe6e3e-9d06-4d6c-a6ad-7076e21771cd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1654 microversion: 2.1 time: 0.204110 Jul 18 16:58:27.606691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 442/878] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:27 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1654 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:27.620438 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-168a839f-0839-484c-8a50-77e29dedd5e4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:27.620438 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-168a839f-0839-484c-8a50-77e29dedd5e4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:27.631103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-eaf8954f-f8df-47d5-8506-c25fd368232b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:27.634123 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-168a839f-0839-484c-8a50-77e29dedd5e4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.634839 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-168a839f-0839-484c-8a50-77e29dedd5e4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.635783 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-168a839f-0839-484c-8a50-77e29dedd5e4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.636369 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-168a839f-0839-484c-8a50-77e29dedd5e4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.646049 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-eaf8954f-f8df-47d5-8506-c25fd368232b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.221133 Jul 18 16:58:27.660604 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 437/879] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:27 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:27.661953 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b329b2e3-1188-40af-88b1-e49fc1d161df tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:27.669831 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b329b2e3-1188-40af-88b1-e49fc1d161df tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.670677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b329b2e3-1188-40af-88b1-e49fc1d161df tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.695102 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b329b2e3-1188-40af-88b1-e49fc1d161df tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Going to try to start instance {{(pid=124868) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 16:58:27.880942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-168a839f-0839-484c-8a50-77e29dedd5e4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:27.890118 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-168a839f-0839-484c-8a50-77e29dedd5e4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:27.891729 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-168a839f-0839-484c-8a50-77e29dedd5e4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:27.892851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-168a839f-0839-484c-8a50-77e29dedd5e4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.285071 Jul 18 16:58:27.893595 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 443/880] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:27 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:27.944901 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b329b2e3-1188-40af-88b1-e49fc1d161df tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "POST /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/action" status: 202 len: 0 microversion: 2.1 time: 0.287778 Jul 18 16:58:27.945905 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 438/881] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 16:58:27 2022] POST /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:58:27.955653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-24cb66f7-9d48-4624-8fad-7cdf5ebaca0d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:27.959963 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-24cb66f7-9d48-4624-8fad-7cdf5ebaca0d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:27.963961 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-24cb66f7-9d48-4624-8fad-7cdf5ebaca0d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.964424 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-24cb66f7-9d48-4624-8fad-7cdf5ebaca0d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.965285 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-24cb66f7-9d48-4624-8fad-7cdf5ebaca0d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.965737 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-24cb66f7-9d48-4624-8fad-7cdf5ebaca0d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.057168 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-e66d4d3a-e5f0-4ec7-a6d6-809aca6b8723 req-7c2deafa-0bf7-40f2-93d0-c6be27c27864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57c0d06-7394-47d2-ab8b-2445e996c9bd", "name": "network-vif-deleted", "tag": "d7caf253-581a-4f92-93cf-cb4bd4b4b2a3"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:28.073868 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e66d4d3a-e5f0-4ec7-a6d6-809aca6b8723 req-7c2deafa-0bf7-40f2-93d0-c6be27c27864 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.073868 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e66d4d3a-e5f0-4ec7-a6d6-809aca6b8723 req-7c2deafa-0bf7-40f2-93d0-c6be27c27864 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.096201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-e66d4d3a-e5f0-4ec7-a6d6-809aca6b8723 req-7c2deafa-0bf7-40f2-93d0-c6be27c27864 service nova] Creating event network-vif-deleted:d7caf253-581a-4f92-93cf-cb4bd4b4b2a3 for instance b57c0d06-7394-47d2-ab8b-2445e996c9bd on hv-cinder-83754 Jul 18 16:58:28.103805 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-e66d4d3a-e5f0-4ec7-a6d6-809aca6b8723 req-7c2deafa-0bf7-40f2-93d0-c6be27c27864 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050697 Jul 18 16:58:28.108175 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 439/882] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:28.157311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-24cb66f7-9d48-4624-8fad-7cdf5ebaca0d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:28.186237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-24cb66f7-9d48-4624-8fad-7cdf5ebaca0d tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1663 microversion: 2.1 time: 0.225484 Jul 18 16:58:28.186237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 444/883] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:27 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1663 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:28.299568 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-11ec49b9-d9d4-4577-b344-46168b7135aa tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:28.301542 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-11ec49b9-d9d4-4577-b344-46168b7135aa tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:28.309043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-11ec49b9-d9d4-4577-b344-46168b7135aa tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.309766 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-11ec49b9-d9d4-4577-b344-46168b7135aa tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.310780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-11ec49b9-d9d4-4577-b344-46168b7135aa tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.311383 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-11ec49b9-d9d4-4577-b344-46168b7135aa tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.362896 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7f9889af-7c6e-4ea7-aa04-27141518d8c8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:28.365450 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7f9889af-7c6e-4ea7-aa04-27141518d8c8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:28.373496 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7f9889af-7c6e-4ea7-aa04-27141518d8c8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.374055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7f9889af-7c6e-4ea7-aa04-27141518d8c8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.375384 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7f9889af-7c6e-4ea7-aa04-27141518d8c8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.376363 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7f9889af-7c6e-4ea7-aa04-27141518d8c8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.432826 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7f9889af-7c6e-4ea7-aa04-27141518d8c8 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074400 Jul 18 16:58:28.434222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-11ec49b9-d9d4-4577-b344-46168b7135aa tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:28.434377 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 445/884] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 16:58:28 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 16:58:28.450678 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-18af411a-0faf-47cc-af8a-f54d11eba9cc tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:28.451831 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-18af411a-0faf-47cc-af8a-f54d11eba9cc tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:28.458339 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18af411a-0faf-47cc-af8a-f54d11eba9cc tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.458795 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18af411a-0faf-47cc-af8a-f54d11eba9cc tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.459837 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18af411a-0faf-47cc-af8a-f54d11eba9cc tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.460362 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18af411a-0faf-47cc-af8a-f54d11eba9cc tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.461527 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-11ec49b9-d9d4-4577-b344-46168b7135aa tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1325 microversion: 2.1 time: 0.166368 Jul 18 16:58:28.476669 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 440/885] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:28 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1325 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:28.544515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-57d7a81a-2690-4da5-81cb-d6a39244b577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:28.545477 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-57d7a81a-2690-4da5-81cb-d6a39244b577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:28.554839 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-57d7a81a-2690-4da5-81cb-d6a39244b577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.555455 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-57d7a81a-2690-4da5-81cb-d6a39244b577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.557255 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-57d7a81a-2690-4da5-81cb-d6a39244b577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.557946 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-57d7a81a-2690-4da5-81cb-d6a39244b577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.563786 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:28.591645 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-57d7a81a-2690-4da5-81cb-d6a39244b577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:58:28.684170 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-18af411a-0faf-47cc-af8a-f54d11eba9cc tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:28.688343 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:28.694469 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-18af411a-0faf-47cc-af8a-f54d11eba9cc tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1757 microversion: 2.1 time: 0.246956 Jul 18 16:58:28.714874 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 446/886] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:28 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1757 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:28.714874 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1e20eefb-7bd7-41f5-80ad-59d4f57f2b06 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:28.714874 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1e20eefb-7bd7-41f5-80ad-59d4f57f2b06 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:28.720703 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e20eefb-7bd7-41f5-80ad-59d4f57f2b06 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.721272 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e20eefb-7bd7-41f5-80ad-59d4f57f2b06 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.722178 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e20eefb-7bd7-41f5-80ad-59d4f57f2b06 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.723030 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e20eefb-7bd7-41f5-80ad-59d4f57f2b06 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.892856 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1e20eefb-7bd7-41f5-80ad-59d4f57f2b06 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:28.901340 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1e20eefb-7bd7-41f5-80ad-59d4f57f2b06 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.193986 Jul 18 16:58:28.902133 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 447/887] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:28 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:28.919124 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0dcb7c8f-c65c-45ee-9501-30c522a0d0a1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:28.920455 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0dcb7c8f-c65c-45ee-9501-30c522a0d0a1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:28.928788 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0dcb7c8f-c65c-45ee-9501-30c522a0d0a1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.929687 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0dcb7c8f-c65c-45ee-9501-30c522a0d0a1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.930895 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0dcb7c8f-c65c-45ee-9501-30c522a0d0a1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.931539 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0dcb7c8f-c65c-45ee-9501-30c522a0d0a1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.105070 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0dcb7c8f-c65c-45ee-9501-30c522a0d0a1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:29.114812 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0dcb7c8f-c65c-45ee-9501-30c522a0d0a1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:29.117811 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0dcb7c8f-c65c-45ee-9501-30c522a0d0a1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:29.119112 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0dcb7c8f-c65c-45ee-9501-30c522a0d0a1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.205268 Jul 18 16:58:29.120224 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 448/888] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:28 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:29.133515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-57d7a81a-2690-4da5-81cb-d6a39244b577 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "DELETE /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 204 len: 0 microversion: 2.1 time: 0.596566 Jul 18 16:58:29.134558 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 441/889] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 16:58:28 2022] DELETE /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:58:29.150746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ba3514c3-430b-4cfe-b7df-4835fd6ee2c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:29.150969 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ba3514c3-430b-4cfe-b7df-4835fd6ee2c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:29.159915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba3514c3-430b-4cfe-b7df-4835fd6ee2c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.159915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba3514c3-430b-4cfe-b7df-4835fd6ee2c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.159915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba3514c3-430b-4cfe-b7df-4835fd6ee2c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.159915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba3514c3-430b-4cfe-b7df-4835fd6ee2c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.194829 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-86e30105-4a62-4b82-8b41-9d76fd60bb3c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:29.195535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-86e30105-4a62-4b82-8b41-9d76fd60bb3c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:29.205345 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86e30105-4a62-4b82-8b41-9d76fd60bb3c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.205797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86e30105-4a62-4b82-8b41-9d76fd60bb3c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.206576 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86e30105-4a62-4b82-8b41-9d76fd60bb3c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.207010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86e30105-4a62-4b82-8b41-9d76fd60bb3c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.307752 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ba3514c3-430b-4cfe-b7df-4835fd6ee2c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:29.316785 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ba3514c3-430b-4cfe-b7df-4835fd6ee2c6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1691 microversion: 2.1 time: 0.171280 Jul 18 16:58:29.317423 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 449/890] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:29 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:29.375616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-86e30105-4a62-4b82-8b41-9d76fd60bb3c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:29.384581 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-86e30105-4a62-4b82-8b41-9d76fd60bb3c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1663 microversion: 2.1 time: 0.194993 Jul 18 16:58:29.385283 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 442/891] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:29 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1663 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:29.481167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4ff21615-bc16-452b-ab23-571c9a23fa93 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:29.481810 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4ff21615-bc16-452b-ab23-571c9a23fa93 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:29.488961 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4ff21615-bc16-452b-ab23-571c9a23fa93 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.489460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4ff21615-bc16-452b-ab23-571c9a23fa93 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.490246 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4ff21615-bc16-452b-ab23-571c9a23fa93 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.491416 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4ff21615-bc16-452b-ab23-571c9a23fa93 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.524446 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4ff21615-bc16-452b-ab23-571c9a23fa93 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.524899 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4ff21615-bc16-452b-ab23-571c9a23fa93 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.525396 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-4ff21615-bc16-452b-ab23-571c9a23fa93 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lazy-loading 'fault' on Instance uuid b57c0d06-7394-47d2-ab8b-2445e996c9bd {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:29.569412 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4ff21615-bc16-452b-ab23-571c9a23fa93 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:29.577486 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4ff21615-bc16-452b-ab23-571c9a23fa93 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1330 microversion: 2.1 time: 0.100217 Jul 18 16:58:29.578071 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 450/892] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:29 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:29.713086 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a8047a86-bf9c-4873-93a1-88edf7370a02 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:29.713461 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a8047a86-bf9c-4873-93a1-88edf7370a02 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:29.720782 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8047a86-bf9c-4873-93a1-88edf7370a02 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.721258 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8047a86-bf9c-4873-93a1-88edf7370a02 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.722169 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8047a86-bf9c-4873-93a1-88edf7370a02 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.722650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8047a86-bf9c-4873-93a1-88edf7370a02 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.773636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-6a20a5df-ac99-49f6-8e2f-62f46734e630 req-92be3099-416e-4ff5-8fdd-1d4e28f99cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55db823-1c00-4ca0-bc6f-cd070459c5e9", "name": "network-vif-plugged", "status": "completed", "tag": "2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:29.782430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-6a20a5df-ac99-49f6-8e2f-62f46734e630 req-92be3099-416e-4ff5-8fdd-1d4e28f99cb0 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.782884 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-6a20a5df-ac99-49f6-8e2f-62f46734e630 req-92be3099-416e-4ff5-8fdd-1d4e28f99cb0 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.796466 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-6a20a5df-ac99-49f6-8e2f-62f46734e630 req-92be3099-416e-4ff5-8fdd-1d4e28f99cb0 service nova] Creating event network-vif-plugged:2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662 for instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 on hv-cinder-83754 Jul 18 16:58:29.801866 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-6a20a5df-ac99-49f6-8e2f-62f46734e630 req-92be3099-416e-4ff5-8fdd-1d4e28f99cb0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043888 Jul 18 16:58:29.802489 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 451/893] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:58:29.888666 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a8047a86-bf9c-4873-93a1-88edf7370a02 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:29.898789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a8047a86-bf9c-4873-93a1-88edf7370a02 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1757 microversion: 2.1 time: 0.189723 Jul 18 16:58:29.899702 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 443/894] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:29 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:29.920419 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5f76e451-3f86-4fcc-bf4c-c0201b301277 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:29.921428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5f76e451-3f86-4fcc-bf4c-c0201b301277 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:29.928101 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f76e451-3f86-4fcc-bf4c-c0201b301277 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.929272 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f76e451-3f86-4fcc-bf4c-c0201b301277 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.929452 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f76e451-3f86-4fcc-bf4c-c0201b301277 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.929845 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f76e451-3f86-4fcc-bf4c-c0201b301277 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.085248 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5f76e451-3f86-4fcc-bf4c-c0201b301277 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:30.093715 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5f76e451-3f86-4fcc-bf4c-c0201b301277 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.177721 Jul 18 16:58:30.094305 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 452/895] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:29 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:30.139226 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-35fc4969-d5ec-4da0-84a7-69183a042d8b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:30.139964 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-35fc4969-d5ec-4da0-84a7-69183a042d8b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:30.147546 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35fc4969-d5ec-4da0-84a7-69183a042d8b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.148043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35fc4969-d5ec-4da0-84a7-69183a042d8b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.148806 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35fc4969-d5ec-4da0-84a7-69183a042d8b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.149263 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35fc4969-d5ec-4da0-84a7-69183a042d8b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.336473 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-adca304d-8312-463b-b62e-c4be70c0d088 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:30.337114 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-adca304d-8312-463b-b62e-c4be70c0d088 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:30.343432 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-adca304d-8312-463b-b62e-c4be70c0d088 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.343875 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-adca304d-8312-463b-b62e-c4be70c0d088 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.344663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-adca304d-8312-463b-b62e-c4be70c0d088 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.345126 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-adca304d-8312-463b-b62e-c4be70c0d088 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.453024 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-35fc4969-d5ec-4da0-84a7-69183a042d8b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:30.461869 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-35fc4969-d5ec-4da0-84a7-69183a042d8b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:30.463481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-35fc4969-d5ec-4da0-84a7-69183a042d8b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:30.464679 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-35fc4969-d5ec-4da0-84a7-69183a042d8b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.330031 Jul 18 16:58:30.465352 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 444/896] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:30 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:30.469850 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f1395d27-2613-4b1a-834e-5f9acba10e4b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:30.470517 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f1395d27-2613-4b1a-834e-5f9acba10e4b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:30.476501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1395d27-2613-4b1a-834e-5f9acba10e4b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.476971 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1395d27-2613-4b1a-834e-5f9acba10e4b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.477758 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1395d27-2613-4b1a-834e-5f9acba10e4b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.478191 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1395d27-2613-4b1a-834e-5f9acba10e4b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.481842 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-adca304d-8312-463b-b62e-c4be70c0d088 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:30.489694 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-adca304d-8312-463b-b62e-c4be70c0d088 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1691 microversion: 2.1 time: 0.158303 Jul 18 16:58:30.490354 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 453/897] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:30 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:30.595875 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2b573df6-d516-4b69-9ed8-3ada5d8f7ff6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:30.596507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2b573df6-d516-4b69-9ed8-3ada5d8f7ff6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:30.603163 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b573df6-d516-4b69-9ed8-3ada5d8f7ff6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.603726 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b573df6-d516-4b69-9ed8-3ada5d8f7ff6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.604578 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b573df6-d516-4b69-9ed8-3ada5d8f7ff6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.605109 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b573df6-d516-4b69-9ed8-3ada5d8f7ff6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.612854 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f1395d27-2613-4b1a-834e-5f9acba10e4b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:30.622555 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f1395d27-2613-4b1a-834e-5f9acba10e4b tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1663 microversion: 2.1 time: 0.154440 Jul 18 16:58:30.623134 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 445/898] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:30 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:30.640836 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b573df6-d516-4b69-9ed8-3ada5d8f7ff6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.641330 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b573df6-d516-4b69-9ed8-3ada5d8f7ff6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.641786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-2b573df6-d516-4b69-9ed8-3ada5d8f7ff6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lazy-loading 'fault' on Instance uuid b57c0d06-7394-47d2-ab8b-2445e996c9bd {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:30.685122 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2b573df6-d516-4b69-9ed8-3ada5d8f7ff6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:30.693708 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2b573df6-d516-4b69-9ed8-3ada5d8f7ff6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1330 microversion: 2.1 time: 0.102057 Jul 18 16:58:30.694813 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 454/899] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:30 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:30.921342 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-86deaf1b-7131-49d9-9e89-70223e245a14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:30.921863 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-86deaf1b-7131-49d9-9e89-70223e245a14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:30.924951 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:30.928450 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86deaf1b-7131-49d9-9e89-70223e245a14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.928903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86deaf1b-7131-49d9-9e89-70223e245a14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.929695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86deaf1b-7131-49d9-9e89-70223e245a14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.930199 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86deaf1b-7131-49d9-9e89-70223e245a14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.090517 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-86deaf1b-7131-49d9-9e89-70223e245a14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:31.098677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-86deaf1b-7131-49d9-9e89-70223e245a14 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1757 microversion: 2.1 time: 0.183664 Jul 18 16:58:31.099241 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 446/900] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:30 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:31.121939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6fe9fcb7-687a-480d-bd33-131095520b0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:31.122457 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6fe9fcb7-687a-480d-bd33-131095520b0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:31.128994 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6fe9fcb7-687a-480d-bd33-131095520b0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.129475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6fe9fcb7-687a-480d-bd33-131095520b0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.130251 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6fe9fcb7-687a-480d-bd33-131095520b0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.130686 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6fe9fcb7-687a-480d-bd33-131095520b0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.270036 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6fe9fcb7-687a-480d-bd33-131095520b0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:31.279990 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6fe9fcb7-687a-480d-bd33-131095520b0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.162115 Jul 18 16:58:31.280645 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 455/901] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:31 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:31.483869 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-778375cb-cbcb-4585-ab0b-110fb7d74a89 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:31.484484 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-778375cb-cbcb-4585-ab0b-110fb7d74a89 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:31.492277 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-778375cb-cbcb-4585-ab0b-110fb7d74a89 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.492731 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-778375cb-cbcb-4585-ab0b-110fb7d74a89 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.493661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-778375cb-cbcb-4585-ab0b-110fb7d74a89 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.494175 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-778375cb-cbcb-4585-ab0b-110fb7d74a89 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.508277 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-56fd8444-32b3-4bc6-9d69-b27645ebbc63 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:31.508983 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-56fd8444-32b3-4bc6-9d69-b27645ebbc63 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:31.511926 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:31.515468 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-56fd8444-32b3-4bc6-9d69-b27645ebbc63 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.515918 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-56fd8444-32b3-4bc6-9d69-b27645ebbc63 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.516688 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-56fd8444-32b3-4bc6-9d69-b27645ebbc63 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.517148 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-56fd8444-32b3-4bc6-9d69-b27645ebbc63 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.634379 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-778375cb-cbcb-4585-ab0b-110fb7d74a89 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:31.643509 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-778375cb-cbcb-4585-ab0b-110fb7d74a89 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:31.645165 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-778375cb-cbcb-4585-ab0b-110fb7d74a89 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:31.646299 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-778375cb-cbcb-4585-ab0b-110fb7d74a89 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.167149 Jul 18 16:58:31.646905 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 447/902] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:31 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:31.652306 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-84008b4d-feca-4c6b-b0b0-2f2f1dd534cb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:31.652967 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-84008b4d-feca-4c6b-b0b0-2f2f1dd534cb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:31.656948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-56fd8444-32b3-4bc6-9d69-b27645ebbc63 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:31.658925 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-84008b4d-feca-4c6b-b0b0-2f2f1dd534cb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.659376 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-84008b4d-feca-4c6b-b0b0-2f2f1dd534cb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.660140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-84008b4d-feca-4c6b-b0b0-2f2f1dd534cb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.660573 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-84008b4d-feca-4c6b-b0b0-2f2f1dd534cb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.664877 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-56fd8444-32b3-4bc6-9d69-b27645ebbc63 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1691 microversion: 2.1 time: 0.161067 Jul 18 16:58:31.665500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 456/903] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:31 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:31.711563 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-17485ff6-a203-41d8-8451-ccdf9ed7444f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:31.712121 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-17485ff6-a203-41d8-8451-ccdf9ed7444f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:31.718330 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17485ff6-a203-41d8-8451-ccdf9ed7444f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.718783 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17485ff6-a203-41d8-8451-ccdf9ed7444f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.719562 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17485ff6-a203-41d8-8451-ccdf9ed7444f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.720001 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17485ff6-a203-41d8-8451-ccdf9ed7444f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.752010 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17485ff6-a203-41d8-8451-ccdf9ed7444f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.752506 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17485ff6-a203-41d8-8451-ccdf9ed7444f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.753158 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-17485ff6-a203-41d8-8451-ccdf9ed7444f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lazy-loading 'fault' on Instance uuid b57c0d06-7394-47d2-ab8b-2445e996c9bd {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:31.797933 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-17485ff6-a203-41d8-8451-ccdf9ed7444f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:31.804957 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-84008b4d-feca-4c6b-b0b0-2f2f1dd534cb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:31.806679 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-17485ff6-a203-41d8-8451-ccdf9ed7444f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1330 microversion: 2.1 time: 0.099317 Jul 18 16:58:31.807378 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 457/904] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:31 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:31.812718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-84008b4d-feca-4c6b-b0b0-2f2f1dd534cb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1663 microversion: 2.1 time: 0.164043 Jul 18 16:58:31.813310 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 448/905] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:31 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:32.116836 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5e606865-c076-48ca-aea1-cd182ae7208c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:32.117480 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5e606865-c076-48ca-aea1-cd182ae7208c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:32.123572 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5e606865-c076-48ca-aea1-cd182ae7208c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.124019 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5e606865-c076-48ca-aea1-cd182ae7208c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.124775 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5e606865-c076-48ca-aea1-cd182ae7208c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.125235 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5e606865-c076-48ca-aea1-cd182ae7208c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.277726 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5e606865-c076-48ca-aea1-cd182ae7208c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:32.286043 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5e606865-c076-48ca-aea1-cd182ae7208c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1757 microversion: 2.1 time: 0.173719 Jul 18 16:58:32.286788 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 458/906] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:32 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:32.300154 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f22e1a63-131b-4d5c-bb56-6a10077e9278 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:32.300772 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f22e1a63-131b-4d5c-bb56-6a10077e9278 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:32.306956 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f22e1a63-131b-4d5c-bb56-6a10077e9278 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.307412 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f22e1a63-131b-4d5c-bb56-6a10077e9278 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.308183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f22e1a63-131b-4d5c-bb56-6a10077e9278 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.308624 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f22e1a63-131b-4d5c-bb56-6a10077e9278 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.449876 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f22e1a63-131b-4d5c-bb56-6a10077e9278 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:32.457464 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f22e1a63-131b-4d5c-bb56-6a10077e9278 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.162137 Jul 18 16:58:32.458025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 449/907] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:32 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:32.664650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-73279223-10df-45c1-936a-42fe0fc16e3c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:32.665193 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-73279223-10df-45c1-936a-42fe0fc16e3c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:32.671390 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73279223-10df-45c1-936a-42fe0fc16e3c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.671839 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73279223-10df-45c1-936a-42fe0fc16e3c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.672595 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73279223-10df-45c1-936a-42fe0fc16e3c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.673055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73279223-10df-45c1-936a-42fe0fc16e3c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.682427 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-eac73abc-62c9-434f-b4d9-7e747b1ad46e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:32.683112 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-eac73abc-62c9-434f-b4d9-7e747b1ad46e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:32.689888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eac73abc-62c9-434f-b4d9-7e747b1ad46e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.690339 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eac73abc-62c9-434f-b4d9-7e747b1ad46e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.691121 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eac73abc-62c9-434f-b4d9-7e747b1ad46e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.691569 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eac73abc-62c9-434f-b4d9-7e747b1ad46e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.815318 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-73279223-10df-45c1-936a-42fe0fc16e3c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:32.825983 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-73279223-10df-45c1-936a-42fe0fc16e3c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:32.827474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-73279223-10df-45c1-936a-42fe0fc16e3c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:32.828590 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-73279223-10df-45c1-936a-42fe0fc16e3c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.168117 Jul 18 16:58:32.829164 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 459/908] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:32 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:32.832673 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-eac73abc-62c9-434f-b4d9-7e747b1ad46e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:32.838941 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1ab05835-6db3-452a-a29a-d3be8d155d61 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:32.842461 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1ab05835-6db3-452a-a29a-d3be8d155d61 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:32.842578 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-eac73abc-62c9-434f-b4d9-7e747b1ad46e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1691 microversion: 2.1 time: 0.163316 Jul 18 16:58:32.842578 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 450/909] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:32 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:32.846108 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ab05835-6db3-452a-a29a-d3be8d155d61 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.846571 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ab05835-6db3-452a-a29a-d3be8d155d61 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.846721 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9a3a1085-be7e-4000-90b9-1a4ebcfa78cf tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:32.847266 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9a3a1085-be7e-4000-90b9-1a4ebcfa78cf tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:32.847384 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ab05835-6db3-452a-a29a-d3be8d155d61 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.847775 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ab05835-6db3-452a-a29a-d3be8d155d61 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.854132 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a3a1085-be7e-4000-90b9-1a4ebcfa78cf tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.854582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a3a1085-be7e-4000-90b9-1a4ebcfa78cf tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.855352 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a3a1085-be7e-4000-90b9-1a4ebcfa78cf tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.855788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a3a1085-be7e-4000-90b9-1a4ebcfa78cf tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.883765 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ab05835-6db3-452a-a29a-d3be8d155d61 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.884266 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ab05835-6db3-452a-a29a-d3be8d155d61 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.884758 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-1ab05835-6db3-452a-a29a-d3be8d155d61 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lazy-loading 'fault' on Instance uuid b57c0d06-7394-47d2-ab8b-2445e996c9bd {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:32.931928 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1ab05835-6db3-452a-a29a-d3be8d155d61 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:32.939506 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1ab05835-6db3-452a-a29a-d3be8d155d61 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 200 len: 1330 microversion: 2.1 time: 0.109337 Jul 18 16:58:32.940181 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 460/910] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:32 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:33.005140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9a3a1085-be7e-4000-90b9-1a4ebcfa78cf tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:33.013623 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9a3a1085-be7e-4000-90b9-1a4ebcfa78cf tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1663 microversion: 2.1 time: 0.170411 Jul 18 16:58:33.014189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 451/911] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:32 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:33.305133 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-63d11b9a-3036-4428-a950-226ef9afa2ac tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:33.305751 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-63d11b9a-3036-4428-a950-226ef9afa2ac tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:33.312428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63d11b9a-3036-4428-a950-226ef9afa2ac tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:33.312920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63d11b9a-3036-4428-a950-226ef9afa2ac tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:33.314472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63d11b9a-3036-4428-a950-226ef9afa2ac tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:33.314920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63d11b9a-3036-4428-a950-226ef9afa2ac tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:33.466756 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-63d11b9a-3036-4428-a950-226ef9afa2ac tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:33.476263 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ee2e4772-8e29-4051-be93-7cb2008b905e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:33.476494 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ee2e4772-8e29-4051-be93-7cb2008b905e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:33.477266 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-63d11b9a-3036-4428-a950-226ef9afa2ac tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1757 microversion: 2.1 time: 0.176799 Jul 18 16:58:33.484156 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 461/912] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:33 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:33.484303 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ee2e4772-8e29-4051-be93-7cb2008b905e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:33.484303 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ee2e4772-8e29-4051-be93-7cb2008b905e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:33.484303 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ee2e4772-8e29-4051-be93-7cb2008b905e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:33.484754 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ee2e4772-8e29-4051-be93-7cb2008b905e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:33.638820 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ee2e4772-8e29-4051-be93-7cb2008b905e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:33.646579 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ee2e4772-8e29-4051-be93-7cb2008b905e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.175167 Jul 18 16:58:33.647971 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 452/913] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:33 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:33.848344 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4e7a84d0-40e9-493b-b63c-7b51bdb67a17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:33.848926 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4e7a84d0-40e9-493b-b63c-7b51bdb67a17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:33.857170 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e7a84d0-40e9-493b-b63c-7b51bdb67a17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:33.857678 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e7a84d0-40e9-493b-b63c-7b51bdb67a17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:33.858554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e7a84d0-40e9-493b-b63c-7b51bdb67a17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:33.859057 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e7a84d0-40e9-493b-b63c-7b51bdb67a17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:33.862627 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1863a632-7907-43d3-9f9b-2f1cb3265fd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:33.863243 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1863a632-7907-43d3-9f9b-2f1cb3265fd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:33.873360 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1863a632-7907-43d3-9f9b-2f1cb3265fd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:33.873821 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1863a632-7907-43d3-9f9b-2f1cb3265fd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:33.874665 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1863a632-7907-43d3-9f9b-2f1cb3265fd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:33.875138 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1863a632-7907-43d3-9f9b-2f1cb3265fd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.046289 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4e7a84d0-40e9-493b-b63c-7b51bdb67a17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:34.050882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:34.057034 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4e7a84d0-40e9-493b-b63c-7b51bdb67a17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:34.059580 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4e7a84d0-40e9-493b-b63c-7b51bdb67a17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:34.061483 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4e7a84d0-40e9-493b-b63c-7b51bdb67a17 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.217188 Jul 18 16:58:34.062208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 462/914] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:33 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:34.067854 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fd165732-46c6-4706-96d5-c10c67acb859 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:34.070317 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fd165732-46c6-4706-96d5-c10c67acb859 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:34.076857 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd165732-46c6-4706-96d5-c10c67acb859 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.077339 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd165732-46c6-4706-96d5-c10c67acb859 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.078250 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd165732-46c6-4706-96d5-c10c67acb859 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.078753 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd165732-46c6-4706-96d5-c10c67acb859 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.093987 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-fd165732-46c6-4706-96d5-c10c67acb859 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fd165732-46c6-4706-96d5-c10c67acb859 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd HTTP/1.1 Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:58:34.098474 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:58:34.099974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:58:34.099974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 16:58:34.099974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 16:58:34.099974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 16:58:34.099974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 16:58:34.099974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:58:34.099974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:58:34.099974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 16:58:34.099974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 16:58:34.099974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 16:58:34.099974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 16:58:34.099974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': 'b57c0d06-7394-47d2-ab8b-2445e996c9bd'} Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:58:34.101528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 16:58:34.102913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:34.104052 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fd165732-46c6-4706-96d5-c10c67acb859 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 404 to user: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:58:34.104052 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fd165732-46c6-4706-96d5-c10c67acb859 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 404 len: 111 microversion: 2.1 time: 0.033969 Jul 18 16:58:34.104052 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 463/915] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:34 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:58:34.109169 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-419ebefb-7267-451c-b328-0ed86d316976 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:34.109881 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-419ebefb-7267-451c-b328-0ed86d316976 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:34.120914 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-419ebefb-7267-451c-b328-0ed86d316976 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.121422 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-419ebefb-7267-451c-b328-0ed86d316976 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.124530 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-419ebefb-7267-451c-b328-0ed86d316976 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.124530 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-419ebefb-7267-451c-b328-0ed86d316976 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.142607 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1863a632-7907-43d3-9f9b-2f1cb3265fd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:34.152247 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1863a632-7907-43d3-9f9b-2f1cb3265fd1 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1691 microversion: 2.1 time: 0.296164 Jul 18 16:58:34.154281 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 453/916] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:33 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1691 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:34.158808 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4234b123-39b4-4c40-b807-88a44bf1eb14 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '.version_select at 0x7f4af14e9310>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:34.250558 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4234b123-39b4-4c40-b807-88a44bf1eb14 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-436802551" status: 202 len: 0 microversion: 2.1 time: 0.095455 Jul 18 16:58:34.251213 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 454/917] 10.222.0.76 () {58 vars in 1217 bytes} [Mon Jul 18 16:58:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-436802551 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:58:34.267924 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-419ebefb-7267-451c-b328-0ed86d316976 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:34.277234 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-419ebefb-7267-451c-b328-0ed86d316976 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1667 microversion: 2.1 time: 0.172064 Jul 18 16:58:34.278005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 464/918] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:34 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1667 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:34.500355 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e662aa6c-d6cd-449d-991b-75330c973a7f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:34.501033 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e662aa6c-d6cd-449d-991b-75330c973a7f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:34.512019 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e662aa6c-d6cd-449d-991b-75330c973a7f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.512453 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e662aa6c-d6cd-449d-991b-75330c973a7f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.513435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e662aa6c-d6cd-449d-991b-75330c973a7f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.514110 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e662aa6c-d6cd-449d-991b-75330c973a7f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.671833 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f048a036-a775-409a-9968-f6f5c82c3820 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:34.672663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f048a036-a775-409a-9968-f6f5c82c3820 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:34.679891 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f048a036-a775-409a-9968-f6f5c82c3820 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.680828 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f048a036-a775-409a-9968-f6f5c82c3820 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.681717 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f048a036-a775-409a-9968-f6f5c82c3820 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.682229 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f048a036-a775-409a-9968-f6f5c82c3820 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.717191 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e662aa6c-d6cd-449d-991b-75330c973a7f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:34.726233 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e662aa6c-d6cd-449d-991b-75330c973a7f tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1760 microversion: 2.1 time: 0.235474 Jul 18 16:58:34.726856 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 455/919] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:34 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1760 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:34.898449 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f048a036-a775-409a-9968-f6f5c82c3820 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:34.906408 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f048a036-a775-409a-9968-f6f5c82c3820 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.239104 Jul 18 16:58:34.906976 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 465/920] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:34 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:35.079769 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9cd0e265-371f-44b3-b296-270cfaf9d516 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:35.080476 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9cd0e265-371f-44b3-b296-270cfaf9d516 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:35.088307 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9cd0e265-371f-44b3-b296-270cfaf9d516 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:35.089253 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9cd0e265-371f-44b3-b296-270cfaf9d516 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:35.090114 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9cd0e265-371f-44b3-b296-270cfaf9d516 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:35.090616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9cd0e265-371f-44b3-b296-270cfaf9d516 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:35.179556 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fe4b7e7f-cecc-47a2-8de2-74e0f25e0f5f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:35.180174 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fe4b7e7f-cecc-47a2-8de2-74e0f25e0f5f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:35.186825 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe4b7e7f-cecc-47a2-8de2-74e0f25e0f5f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:35.187672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe4b7e7f-cecc-47a2-8de2-74e0f25e0f5f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:35.188899 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe4b7e7f-cecc-47a2-8de2-74e0f25e0f5f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:35.190001 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe4b7e7f-cecc-47a2-8de2-74e0f25e0f5f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:35.365984 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9cd0e265-371f-44b3-b296-270cfaf9d516 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:35.377866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9cd0e265-371f-44b3-b296-270cfaf9d516 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:35.378211 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9cd0e265-371f-44b3-b296-270cfaf9d516 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:35.380481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9cd0e265-371f-44b3-b296-270cfaf9d516 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.304288 Jul 18 16:58:35.381372 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 456/921] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:35 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:35.386436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1b9a05a3-2d84-4c69-a475-2f3ac72aca6c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Action: 'create', calling method: .version_select at 0x7f4af14e9550>, body: {"keypair": {"name": "tempest-keypair-134818614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKX9d4TQfL1tDzmwC8O3xMGzsnnzUCkp8zx37JklxFTwwNnHSjDTejHOTxb20QjUaNfI5q/drXNYZDdJkm6KPUHCROtlP8W2erjxp4Jhdn25A1uiG8wnBmqA/zj3J4+sUA=="}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:35.402404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-1b9a05a3-2d84-4c69-a475-2f3ac72aca6c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for project 4f82344d2255427582cc29e253b37f0b. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:58:35.406434 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-1b9a05a3-2d84-4c69-a475-2f3ac72aca6c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for user 0cf277a2d03443c8af7a7bee2731d9d1 and project 4f82344d2255427582cc29e253b37f0b. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:58:35.495533 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fe4b7e7f-cecc-47a2-8de2-74e0f25e0f5f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:35.503251 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fe4b7e7f-cecc-47a2-8de2-74e0f25e0f5f tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1691 microversion: 2.1 time: 0.328452 Jul 18 16:58:35.505736 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 466/922] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:35 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1691 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:35.533314 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1b9a05a3-2d84-4c69-a475-2f3ac72aca6c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.150731 Jul 18 16:58:35.534021 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 457/923] 10.222.0.76 () {60 vars in 1158 bytes} [Mon Jul 18 16:58:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:35.924530 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3fa3f210-3e15-4faf-a052-fd1bf0bd79d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:35.925199 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3fa3f210-3e15-4faf-a052-fd1bf0bd79d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:35.933527 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3fa3f210-3e15-4faf-a052-fd1bf0bd79d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:35.933972 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3fa3f210-3e15-4faf-a052-fd1bf0bd79d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:35.934756 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3fa3f210-3e15-4faf-a052-fd1bf0bd79d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:35.935210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3fa3f210-3e15-4faf-a052-fd1bf0bd79d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:36.095599 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3fa3f210-3e15-4faf-a052-fd1bf0bd79d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:36.105734 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3fa3f210-3e15-4faf-a052-fd1bf0bd79d4 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.185051 Jul 18 16:58:36.106542 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 467/924] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:35 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:36.400947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ff4f9e5b-a60d-4fbf-b866-d2c139a8471b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:36.406789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ff4f9e5b-a60d-4fbf-b866-d2c139a8471b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:36.409946 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff4f9e5b-a60d-4fbf-b866-d2c139a8471b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:36.410673 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff4f9e5b-a60d-4fbf-b866-d2c139a8471b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:36.411762 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff4f9e5b-a60d-4fbf-b866-d2c139a8471b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:36.412955 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff4f9e5b-a60d-4fbf-b866-d2c139a8471b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:36.417498 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:36.467428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-195c1bef-3895-4514-9ca5-aaa0ce05aa9a req-3297e267-425d-4cdf-847d-9b0d0eeef836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10246df8-f808-47a9-947f-af78a2fd64c9", "name": "network-vif-deleted", "tag": "4df48297-725a-439e-bb47-a2b832df545f"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:36.480808 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-195c1bef-3895-4514-9ca5-aaa0ce05aa9a req-3297e267-425d-4cdf-847d-9b0d0eeef836 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:36.481299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-195c1bef-3895-4514-9ca5-aaa0ce05aa9a req-3297e267-425d-4cdf-847d-9b0d0eeef836 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:36.497463 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-195c1bef-3895-4514-9ca5-aaa0ce05aa9a req-3297e267-425d-4cdf-847d-9b0d0eeef836 service nova] Creating event network-vif-deleted:4df48297-725a-439e-bb47-a2b832df545f for instance 10246df8-f808-47a9-947f-af78a2fd64c9 on hv-cinder-83754 Jul 18 16:58:36.504260 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-195c1bef-3895-4514-9ca5-aaa0ce05aa9a req-3297e267-425d-4cdf-847d-9b0d0eeef836 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040891 Jul 18 16:58:36.507912 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 468/925] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:36.523645 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2eb53022-52e1-4857-895d-c00a6e433170 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:36.525564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2eb53022-52e1-4857-895d-c00a6e433170 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:36.534053 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2eb53022-52e1-4857-895d-c00a6e433170 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:36.535382 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2eb53022-52e1-4857-895d-c00a6e433170 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:36.536462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2eb53022-52e1-4857-895d-c00a6e433170 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:36.538924 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2eb53022-52e1-4857-895d-c00a6e433170 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:36.625643 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2eb53022-52e1-4857-895d-c00a6e433170 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:36.634662 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2eb53022-52e1-4857-895d-c00a6e433170 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1623 microversion: 2.1 time: 0.116800 Jul 18 16:58:36.635558 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 469/926] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:36 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1623 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:36.671070 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ff4f9e5b-a60d-4fbf-b866-d2c139a8471b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:36.692744 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ff4f9e5b-a60d-4fbf-b866-d2c139a8471b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:36.695374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ff4f9e5b-a60d-4fbf-b866-d2c139a8471b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:36.698727 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ff4f9e5b-a60d-4fbf-b866-d2c139a8471b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.302863 Jul 18 16:58:36.699662 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 458/927] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:36 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:37.127242 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-66262730-5e1a-4a1b-a5da-1c09e2ce4d87 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:37.127953 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-66262730-5e1a-4a1b-a5da-1c09e2ce4d87 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:37.135232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-66262730-5e1a-4a1b-a5da-1c09e2ce4d87 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:37.135691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-66262730-5e1a-4a1b-a5da-1c09e2ce4d87 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:37.136476 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-66262730-5e1a-4a1b-a5da-1c09e2ce4d87 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:37.136920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-66262730-5e1a-4a1b-a5da-1c09e2ce4d87 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:37.291543 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-66262730-5e1a-4a1b-a5da-1c09e2ce4d87 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:37.299759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-66262730-5e1a-4a1b-a5da-1c09e2ce4d87 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.177385 Jul 18 16:58:37.300445 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 470/928] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:37 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:37.652853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-45f0eac6-53c0-4951-9c57-38df6b25ac23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:37.654382 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-45f0eac6-53c0-4951-9c57-38df6b25ac23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:37.662058 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45f0eac6-53c0-4951-9c57-38df6b25ac23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:37.662822 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45f0eac6-53c0-4951-9c57-38df6b25ac23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:37.663541 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45f0eac6-53c0-4951-9c57-38df6b25ac23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:37.664154 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45f0eac6-53c0-4951-9c57-38df6b25ac23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:37.699697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45f0eac6-53c0-4951-9c57-38df6b25ac23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:37.700153 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45f0eac6-53c0-4951-9c57-38df6b25ac23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:37.700621 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-45f0eac6-53c0-4951-9c57-38df6b25ac23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lazy-loading 'fault' on Instance uuid 10246df8-f808-47a9-947f-af78a2fd64c9 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:37.717677 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-75c2a0c9-893f-4fb3-95a8-617cb5d5950b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:37.718283 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-75c2a0c9-893f-4fb3-95a8-617cb5d5950b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:37.725372 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-75c2a0c9-893f-4fb3-95a8-617cb5d5950b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:37.726016 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-75c2a0c9-893f-4fb3-95a8-617cb5d5950b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:37.726789 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-75c2a0c9-893f-4fb3-95a8-617cb5d5950b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:37.727224 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-75c2a0c9-893f-4fb3-95a8-617cb5d5950b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:37.745182 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-45f0eac6-53c0-4951-9c57-38df6b25ac23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:37.752474 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-45f0eac6-53c0-4951-9c57-38df6b25ac23 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1335 microversion: 2.1 time: 0.103632 Jul 18 16:58:37.753060 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 459/929] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:37 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:37.872771 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-75c2a0c9-893f-4fb3-95a8-617cb5d5950b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:37.884827 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-75c2a0c9-893f-4fb3-95a8-617cb5d5950b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:37.886542 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-75c2a0c9-893f-4fb3-95a8-617cb5d5950b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:37.887642 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-75c2a0c9-893f-4fb3-95a8-617cb5d5950b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1407 microversion: 2.20 time: 0.173850 Jul 18 16:58:37.888198 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 471/930] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:37 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:38.317228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c438109d-a549-4e7a-9f22-855a7fe27694 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:38.317980 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c438109d-a549-4e7a-9f22-855a7fe27694 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:38.325826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c438109d-a549-4e7a-9f22-855a7fe27694 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:38.326289 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c438109d-a549-4e7a-9f22-855a7fe27694 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:38.327075 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c438109d-a549-4e7a-9f22-855a7fe27694 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:38.327513 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c438109d-a549-4e7a-9f22-855a7fe27694 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:38.330797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-185596015", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae3a9cc1-1c89-413a-9dc0-c337425ad213"}], "security_groups": [{"name": "tempest-securitygroup--1871351406"}], "key_name": "tempest-keypair-134818614", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:38.442441 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] validate_networks() for [('ae3a9cc1-1c89-413a-9dc0-c337425ad213', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:58:38.480075 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c438109d-a549-4e7a-9f22-855a7fe27694 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:38.498811 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c438109d-a549-4e7a-9f22-855a7fe27694 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.185346 Jul 18 16:58:38.499437 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 460/931] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:38 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:38.770080 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-59254239-2c97-4420-97d5-63942aa3cca6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:38.770964 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-59254239-2c97-4420-97d5-63942aa3cca6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:38.779124 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-59254239-2c97-4420-97d5-63942aa3cca6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:38.779764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-59254239-2c97-4420-97d5-63942aa3cca6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:38.781809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-59254239-2c97-4420-97d5-63942aa3cca6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:38.781809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-59254239-2c97-4420-97d5-63942aa3cca6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:38.815576 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-59254239-2c97-4420-97d5-63942aa3cca6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:38.816284 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-59254239-2c97-4420-97d5-63942aa3cca6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:38.816571 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-59254239-2c97-4420-97d5-63942aa3cca6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lazy-loading 'fault' on Instance uuid 10246df8-f808-47a9-947f-af78a2fd64c9 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:38.846611 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:58:38.847042 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:58:38.847524 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:58:38.848042 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:58:38.848464 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:58:38.857683 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:38.858137 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:38.859040 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:38.859772 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:38.860042 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-59254239-2c97-4420-97d5-63942aa3cca6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:38.870909 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-59254239-2c97-4420-97d5-63942aa3cca6 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 200 len: 1335 microversion: 2.1 time: 0.104874 Jul 18 16:58:38.871582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 461/932] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:38 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:38.879710 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for project 4f82344d2255427582cc29e253b37f0b. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:58:38.884411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for user 0cf277a2d03443c8af7a7bee2731d9d1 and project 4f82344d2255427582cc29e253b37f0b. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:58:38.895778 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:58:38.898480 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:58:38.905895 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-00dd57f5-e74a-48bb-99e7-375172430ab1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:38.906506 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-00dd57f5-e74a-48bb-99e7-375172430ab1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:38.913117 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-00dd57f5-e74a-48bb-99e7-375172430ab1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:38.913731 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-00dd57f5-e74a-48bb-99e7-375172430ab1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:38.914561 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-00dd57f5-e74a-48bb-99e7-375172430ab1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:38.915007 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-00dd57f5-e74a-48bb-99e7-375172430ab1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:39.047798 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-00dd57f5-e74a-48bb-99e7-375172430ab1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:39.056612 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-00dd57f5-e74a-48bb-99e7-375172430ab1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:39.058130 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-00dd57f5-e74a-48bb-99e7-375172430ab1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:39.059320 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-00dd57f5-e74a-48bb-99e7-375172430ab1 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1600 microversion: 2.20 time: 0.157279 Jul 18 16:58:39.060526 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 462/933] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:38 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:39.075933 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-47d56e33-8bc1-4900-9cc6-27ad30b8392a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.749800 Jul 18 16:58:39.076683 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 472/934] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 16:58:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 16:58:39.087893 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b76190fc-df15-40b1-b24d-1adcc14e9f0f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:39.088519 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b76190fc-df15-40b1-b24d-1adcc14e9f0f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:39.088739 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-86a2e635-4bee-4065-ba34-af86b50be0a2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:39.089456 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-86a2e635-4bee-4065-ba34-af86b50be0a2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:39.096211 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b76190fc-df15-40b1-b24d-1adcc14e9f0f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:39.096759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b76190fc-df15-40b1-b24d-1adcc14e9f0f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:39.097651 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b76190fc-df15-40b1-b24d-1adcc14e9f0f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:39.098185 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b76190fc-df15-40b1-b24d-1adcc14e9f0f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:39.153716 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-86a2e635-4bee-4065-ba34-af86b50be0a2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:39.162201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-86a2e635-4bee-4065-ba34-af86b50be0a2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1240 microversion: 2.1 time: 0.078135 Jul 18 16:58:39.162957 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 463/935] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:39 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:39.196148 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b76190fc-df15-40b1-b24d-1adcc14e9f0f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.112309 Jul 18 16:58:39.196805 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 473/936] 10.222.0.76 () {60 vars in 1315 bytes} [Mon Jul 18 16:58:39 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:58:39.517311 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9cf0d4d9-6ec8-4de4-b0f2-5cbdfa3a2edd tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:39.524930 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9cf0d4d9-6ec8-4de4-b0f2-5cbdfa3a2edd tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:39.524930 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9cf0d4d9-6ec8-4de4-b0f2-5cbdfa3a2edd tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:39.524930 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9cf0d4d9-6ec8-4de4-b0f2-5cbdfa3a2edd tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:39.525526 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9cf0d4d9-6ec8-4de4-b0f2-5cbdfa3a2edd tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:39.525957 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9cf0d4d9-6ec8-4de4-b0f2-5cbdfa3a2edd tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:39.778442 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9cf0d4d9-6ec8-4de4-b0f2-5cbdfa3a2edd tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:39.786690 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9cf0d4d9-6ec8-4de4-b0f2-5cbdfa3a2edd tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.273620 Jul 18 16:58:39.787836 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 464/937] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:39 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:39.888052 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0e2c1c68-cab7-4ea7-aa3a-97e2e426f483 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:39.888694 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0e2c1c68-cab7-4ea7-aa3a-97e2e426f483 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 10246df8-f808-47a9-947f-af78a2fd64c9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:39.895310 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0e2c1c68-cab7-4ea7-aa3a-97e2e426f483 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:39.895756 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0e2c1c68-cab7-4ea7-aa3a-97e2e426f483 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:39.897125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0e2c1c68-cab7-4ea7-aa3a-97e2e426f483 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:39.897574 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0e2c1c68-cab7-4ea7-aa3a-97e2e426f483 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-0e2c1c68-cab7-4ea7-aa3a-97e2e426f483 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] HTTP exception thrown: Instance 10246df8-f808-47a9-947f-af78a2fd64c9 could not be found. Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0e2c1c68-cab7-4ea7-aa3a-97e2e426f483 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Request method failure captured: Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 HTTP/1.1 Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y-TiVRFIxQUFS3o-vF1tU9Gsir476hfPwg6-9QY-ekQJczP403moh-x5hK5fdr7Kyenyms_fsEbsImWQwwhBO-dS1lqDFJndVpqEGo5Vn-47C8Aj-o3gFI_Qx_JhbRvmzfNos5WqnfrA286SqwZvQAoPFHOJXCA-yaId_liYvjAawc Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 2e5e262f0ed548ee8a4450d0d4806667 Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:58:39.917168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:58:39.918920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:58:39.918920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:58:39.918920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 2e5e262f0ed548ee8a4450d0d4806667 Jul 18 16:58:39.918920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:58:39.918920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-ServerRescueNegativeTestJSON-1412367741-project Jul 18 16:58:39.918920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:58:39.918920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:58:39.918920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 4d27db5cdd9e453dbd93b862db694309 Jul 18 16:58:39.918920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1412367741-project Jul 18 16:58:39.918920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 16:58:39.918920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance 10246df8-f808-47a9-947f-af78a2fd64c9 could not be found. Jul 18 16:58:39.918920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '10246df8-f808-47a9-947f-af78a2fd64c9'} Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10246df8-f808-47a9-947f-af78a2fd64c9 could not be found. Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:58:39.919806 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10246df8-f808-47a9-947f-af78a2fd64c9 could not be found. Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10246df8-f808-47a9-947f-af78a2fd64c9 could not be found. Jul 18 16:58:39.921241 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:39.922553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0e2c1c68-cab7-4ea7-aa3a-97e2e426f483 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Returning 404 to user: Instance 10246df8-f808-47a9-947f-af78a2fd64c9 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:58:39.922553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0e2c1c68-cab7-4ea7-aa3a-97e2e426f483 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9" status: 404 len: 111 microversion: 2.1 time: 0.033732 Jul 18 16:58:39.922553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 474/938] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:39 2022] GET /compute/v2.1/servers/10246df8-f808-47a9-947f-af78a2fd64c9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:58:39.927416 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fa8af061-a70b-42f8-b99a-b4074c44b876 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '.version_select at 0x7f4af14ef820>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:40.074545 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fa8af061-a70b-42f8-b99a-b4074c44b876 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147791083" status: 202 len: 0 microversion: 2.1 time: 0.151017 Jul 18 16:58:40.075246 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 465/939] 10.222.0.76 () {58 vars in 1220 bytes} [Mon Jul 18 16:58:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147791083 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:58:40.182169 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9ef535b9-e7d2-4bfa-b35c-b1b90e7eeba4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:40.182907 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9ef535b9-e7d2-4bfa-b35c-b1b90e7eeba4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:40.189859 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ef535b9-e7d2-4bfa-b35c-b1b90e7eeba4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:40.190408 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ef535b9-e7d2-4bfa-b35c-b1b90e7eeba4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:40.191332 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ef535b9-e7d2-4bfa-b35c-b1b90e7eeba4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:40.191897 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ef535b9-e7d2-4bfa-b35c-b1b90e7eeba4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:40.279017 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9ef535b9-e7d2-4bfa-b35c-b1b90e7eeba4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:40.286724 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9ef535b9-e7d2-4bfa-b35c-b1b90e7eeba4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1244 microversion: 2.1 time: 0.108908 Jul 18 16:58:40.287843 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 475/940] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:40 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1244 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:40.402204 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-9a62ea25-b74b-4b57-b752-c32feaab78ef req-95f88f54-0921-46ba-a8c4-b87283b1cbea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55db823-1c00-4ca0-bc6f-cd070459c5e9", "tag": "2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:40.413979 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-9a62ea25-b74b-4b57-b752-c32feaab78ef req-95f88f54-0921-46ba-a8c4-b87283b1cbea service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:40.414553 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-9a62ea25-b74b-4b57-b752-c32feaab78ef req-95f88f54-0921-46ba-a8c4-b87283b1cbea service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:40.430100 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-9a62ea25-b74b-4b57-b752-c32feaab78ef req-95f88f54-0921-46ba-a8c4-b87283b1cbea service nova] Creating event network-changed:2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662 for instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 on hv-cinder-83754 Jul 18 16:58:40.435936 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-9a62ea25-b74b-4b57-b752-c32feaab78ef req-95f88f54-0921-46ba-a8c4-b87283b1cbea service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038948 Jul 18 16:58:40.437291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 466/941] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:40.805201 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2f6210af-472a-4606-897a-6c6b64812eb6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:40.806212 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2f6210af-472a-4606-897a-6c6b64812eb6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:40.814186 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2f6210af-472a-4606-897a-6c6b64812eb6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:40.814186 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2f6210af-472a-4606-897a-6c6b64812eb6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:40.815061 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2f6210af-472a-4606-897a-6c6b64812eb6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:40.815783 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2f6210af-472a-4606-897a-6c6b64812eb6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:41.097521 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2f6210af-472a-4606-897a-6c6b64812eb6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:41.109042 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2f6210af-472a-4606-897a-6c6b64812eb6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.307774 Jul 18 16:58:41.109797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 476/942] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:40 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:41.307764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e357b7dd-3773-4edb-a2d8-99cc4cfc9d2c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:41.308479 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e357b7dd-3773-4edb-a2d8-99cc4cfc9d2c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:41.314982 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e357b7dd-3773-4edb-a2d8-99cc4cfc9d2c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:41.315440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e357b7dd-3773-4edb-a2d8-99cc4cfc9d2c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:41.316214 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e357b7dd-3773-4edb-a2d8-99cc4cfc9d2c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:41.316652 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e357b7dd-3773-4edb-a2d8-99cc4cfc9d2c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:41.382717 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e357b7dd-3773-4edb-a2d8-99cc4cfc9d2c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:41.393093 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e357b7dd-3773-4edb-a2d8-99cc4cfc9d2c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1292 microversion: 2.1 time: 0.090296 Jul 18 16:58:41.401911 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 467/943] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:41 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:42.126955 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c5408341-e629-433b-b5a0-b0c181cb147e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:42.127586 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c5408341-e629-433b-b5a0-b0c181cb147e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:42.136020 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c5408341-e629-433b-b5a0-b0c181cb147e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:42.136576 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c5408341-e629-433b-b5a0-b0c181cb147e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:42.137439 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c5408341-e629-433b-b5a0-b0c181cb147e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:42.137947 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c5408341-e629-433b-b5a0-b0c181cb147e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:42.290333 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c5408341-e629-433b-b5a0-b0c181cb147e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:42.298142 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c5408341-e629-433b-b5a0-b0c181cb147e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1508 microversion: 2.1 time: 0.175166 Jul 18 16:58:42.298715 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 477/944] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:42 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:42.315832 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-13ab97f3-3016-4f1e-a891-0da23b361f0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:42.316412 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-13ab97f3-3016-4f1e-a891-0da23b361f0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:42.323008 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13ab97f3-3016-4f1e-a891-0da23b361f0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:42.323473 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13ab97f3-3016-4f1e-a891-0da23b361f0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:42.324241 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13ab97f3-3016-4f1e-a891-0da23b361f0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:42.324683 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13ab97f3-3016-4f1e-a891-0da23b361f0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:42.409098 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dba61e11-dee2-45db-8f25-dc229b83cb43 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:42.410173 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dba61e11-dee2-45db-8f25-dc229b83cb43 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:42.426198 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dba61e11-dee2-45db-8f25-dc229b83cb43 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:42.426776 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dba61e11-dee2-45db-8f25-dc229b83cb43 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:42.428295 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dba61e11-dee2-45db-8f25-dc229b83cb43 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:42.428919 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dba61e11-dee2-45db-8f25-dc229b83cb43 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:42.509243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dba61e11-dee2-45db-8f25-dc229b83cb43 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:42.517538 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dba61e11-dee2-45db-8f25-dc229b83cb43 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1310 microversion: 2.1 time: 0.112485 Jul 18 16:58:42.518103 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 478/945] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:42 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1310 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:42.647799 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-13ab97f3-3016-4f1e-a891-0da23b361f0a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "POST /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d/action" status: 202 len: 0 microversion: 2.1 time: 0.335755 Jul 18 16:58:42.648426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 468/946] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 16:58:42 2022] POST /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:58:42.657185 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b67124b5-e012-4f56-a70e-7959f23e5402 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:42.658003 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b67124b5-e012-4f56-a70e-7959f23e5402 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:42.667107 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b67124b5-e012-4f56-a70e-7959f23e5402 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:42.667750 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b67124b5-e012-4f56-a70e-7959f23e5402 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:42.668732 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b67124b5-e012-4f56-a70e-7959f23e5402 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:42.669282 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b67124b5-e012-4f56-a70e-7959f23e5402 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:42.814555 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b67124b5-e012-4f56-a70e-7959f23e5402 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:42.822595 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b67124b5-e012-4f56-a70e-7959f23e5402 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1516 microversion: 2.1 time: 0.169814 Jul 18 16:58:42.823169 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 479/947] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:42 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:43.536622 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-c427acf7-e834-4cfd-bbd7-1e7309a16109 req-f9400941-c2c6-4a55-9c11-c12fa81b9303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d25fa4-9505-4471-a0be-e3a486297f2d", "name": "network-vif-unplugged", "status": "completed", "tag": "f3c39284-35e1-4778-990a-0024c4b94641"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:43.537980 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d39a81e6-0d8c-4f21-b4de-aceba1377c97 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:43.538614 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d39a81e6-0d8c-4f21-b4de-aceba1377c97 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:43.547548 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c427acf7-e834-4cfd-bbd7-1e7309a16109 req-f9400941-c2c6-4a55-9c11-c12fa81b9303 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:43.548040 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d39a81e6-0d8c-4f21-b4de-aceba1377c97 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:43.548152 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c427acf7-e834-4cfd-bbd7-1e7309a16109 req-f9400941-c2c6-4a55-9c11-c12fa81b9303 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:43.548529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d39a81e6-0d8c-4f21-b4de-aceba1377c97 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:43.549551 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d39a81e6-0d8c-4f21-b4de-aceba1377c97 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:43.549999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d39a81e6-0d8c-4f21-b4de-aceba1377c97 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:43.562383 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.compute.server_external_events [req-c427acf7-e834-4cfd-bbd7-1e7309a16109 req-f9400941-c2c6-4a55-9c11-c12fa81b9303 service nova] Unable to find a host for instance 87d25fa4-9505-4471-a0be-e3a486297f2d. Dropping event network-vif-unplugged {{(pid=124867) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 16:58:43.563427 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-c427acf7-e834-4cfd-bbd7-1e7309a16109 req-f9400941-c2c6-4a55-9c11-c12fa81b9303 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031739 Jul 18 16:58:43.564093 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 480/948] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 16:58:43.761944 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d39a81e6-0d8c-4f21-b4de-aceba1377c97 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:43.770232 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d39a81e6-0d8c-4f21-b4de-aceba1377c97 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1366 microversion: 2.1 time: 0.238377 Jul 18 16:58:43.780309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 469/949] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:43 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:43.795086 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ae49270b-0d1c-402f-9e41-0668848a26fd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:43.795588 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ae49270b-0d1c-402f-9e41-0668848a26fd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:43.802250 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae49270b-0d1c-402f-9e41-0668848a26fd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:43.803366 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae49270b-0d1c-402f-9e41-0668848a26fd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:43.804170 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae49270b-0d1c-402f-9e41-0668848a26fd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:43.804693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae49270b-0d1c-402f-9e41-0668848a26fd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:43.830702 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ae49270b-0d1c-402f-9e41-0668848a26fd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:58:43.840383 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-65bf742f-4ccc-4d04-9c7e-34eb67f3a504 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:43.840984 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-65bf742f-4ccc-4d04-9c7e-34eb67f3a504 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:43.850003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-65bf742f-4ccc-4d04-9c7e-34eb67f3a504 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:43.850543 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-65bf742f-4ccc-4d04-9c7e-34eb67f3a504 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:43.851443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-65bf742f-4ccc-4d04-9c7e-34eb67f3a504 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:43.851946 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-65bf742f-4ccc-4d04-9c7e-34eb67f3a504 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:44.016848 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:44.082026 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-65bf742f-4ccc-4d04-9c7e-34eb67f3a504 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:44.090689 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-65bf742f-4ccc-4d04-9c7e-34eb67f3a504 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1518 microversion: 2.1 time: 0.253774 Jul 18 16:58:44.101769 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 470/950] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:43 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1518 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:44.332730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-3d2b0a8a-b6ac-4cd6-8c3f-a8a90b85a180 req-3716bf79-44e6-43eb-80fd-4049e557da53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d0d7ca-fd48-4083-9569-18fb20c564a9", "tag": "3b49a420-2c47-4e76-aaed-02ecf0bb74aa"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:44.342210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ae49270b-0d1c-402f-9e41-0668848a26fd tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 204 len: 0 microversion: 2.1 time: 0.550601 Jul 18 16:58:44.342425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-3d2b0a8a-b6ac-4cd6-8c3f-a8a90b85a180 req-3716bf79-44e6-43eb-80fd-4049e557da53 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:44.342742 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-3d2b0a8a-b6ac-4cd6-8c3f-a8a90b85a180 req-3716bf79-44e6-43eb-80fd-4049e557da53 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:44.350245 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 481/951] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 16:58:43 2022] DELETE /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:58:44.356711 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-3d2b0a8a-b6ac-4cd6-8c3f-a8a90b85a180 req-3716bf79-44e6-43eb-80fd-4049e557da53 service nova] Creating event network-changed:3b49a420-2c47-4e76-aaed-02ecf0bb74aa for instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 on hv-cinder-83754 Jul 18 16:58:44.362005 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-3d2b0a8a-b6ac-4cd6-8c3f-a8a90b85a180 req-3716bf79-44e6-43eb-80fd-4049e557da53 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032700 Jul 18 16:58:44.362494 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-865bef67-c695-4c56-af35-634196c8aa71 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:44.364058 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-865bef67-c695-4c56-af35-634196c8aa71 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:44.364215 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 471/952] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:58:44.372153 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-865bef67-c695-4c56-af35-634196c8aa71 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:44.372687 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-865bef67-c695-4c56-af35-634196c8aa71 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:44.373582 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-865bef67-c695-4c56-af35-634196c8aa71 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:44.374290 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-865bef67-c695-4c56-af35-634196c8aa71 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:44.516935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-865bef67-c695-4c56-af35-634196c8aa71 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:44.525195 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-865bef67-c695-4c56-af35-634196c8aa71 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1509 microversion: 2.1 time: 0.170433 Jul 18 16:58:44.525759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 482/953] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:44 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:44.788719 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-233d020a-20aa-409a-8f97-e659189f4e82 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:44.789558 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-233d020a-20aa-409a-8f97-e659189f4e82 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:44.796035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-233d020a-20aa-409a-8f97-e659189f4e82 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:44.796492 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-233d020a-20aa-409a-8f97-e659189f4e82 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:44.798232 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-233d020a-20aa-409a-8f97-e659189f4e82 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:44.798684 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-233d020a-20aa-409a-8f97-e659189f4e82 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:44.971420 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-233d020a-20aa-409a-8f97-e659189f4e82 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:44.979183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-233d020a-20aa-409a-8f97-e659189f4e82 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1366 microversion: 2.1 time: 0.195402 Jul 18 16:58:45.002653 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 472/954] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:44 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:45.107782 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4347a43a-42b5-4050-9a52-159c7b9caefb tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:45.108404 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4347a43a-42b5-4050-9a52-159c7b9caefb tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:45.116599 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4347a43a-42b5-4050-9a52-159c7b9caefb tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:45.117071 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4347a43a-42b5-4050-9a52-159c7b9caefb tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:45.117937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4347a43a-42b5-4050-9a52-159c7b9caefb tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:45.118406 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4347a43a-42b5-4050-9a52-159c7b9caefb tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:45.255788 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4347a43a-42b5-4050-9a52-159c7b9caefb tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:45.263453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4347a43a-42b5-4050-9a52-159c7b9caefb tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1518 microversion: 2.1 time: 0.159697 Jul 18 16:58:45.264015 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 483/955] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:45 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:45.543075 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-43ab35e8-ae0f-4d5e-a4ed-e38266f44889 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:45.543709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-43ab35e8-ae0f-4d5e-a4ed-e38266f44889 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:45.550157 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43ab35e8-ae0f-4d5e-a4ed-e38266f44889 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:45.550618 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43ab35e8-ae0f-4d5e-a4ed-e38266f44889 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:45.551398 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43ab35e8-ae0f-4d5e-a4ed-e38266f44889 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:45.551837 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43ab35e8-ae0f-4d5e-a4ed-e38266f44889 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:45.760868 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-43ab35e8-ae0f-4d5e-a4ed-e38266f44889 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:45.768923 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-43ab35e8-ae0f-4d5e-a4ed-e38266f44889 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1509 microversion: 2.1 time: 0.229836 Jul 18 16:58:45.769479 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 473/956] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:45 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:45.996867 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fb84133a-3170-414b-bda9-c8807a4167ba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:45.997773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fb84133a-3170-414b-bda9-c8807a4167ba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:46.003829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb84133a-3170-414b-bda9-c8807a4167ba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:46.004276 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb84133a-3170-414b-bda9-c8807a4167ba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:46.005061 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb84133a-3170-414b-bda9-c8807a4167ba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:46.005497 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb84133a-3170-414b-bda9-c8807a4167ba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:46.214748 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fb84133a-3170-414b-bda9-c8807a4167ba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:46.222974 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fb84133a-3170-414b-bda9-c8807a4167ba tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1366 microversion: 2.1 time: 0.230598 Jul 18 16:58:46.223553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 484/957] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:45 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:46.280765 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-960e710d-fd19-4cff-b3f3-965962b2bdee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:46.281415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-960e710d-fd19-4cff-b3f3-965962b2bdee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:46.289351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-960e710d-fd19-4cff-b3f3-965962b2bdee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:46.289842 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-960e710d-fd19-4cff-b3f3-965962b2bdee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:46.291656 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-960e710d-fd19-4cff-b3f3-965962b2bdee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:46.291656 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-960e710d-fd19-4cff-b3f3-965962b2bdee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:46.380962 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-ba56b193-5174-4ad9-ac8b-9c70f552f143 req-26d5edb9-b5cb-45c2-8c09-6b62bd9643b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0ce676-a485-4100-8afa-a6bc5efacf8f", "name": "network-vif-deleted", "tag": "829b066e-4335-4351-899c-03b885192e39"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:46.389368 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-ba56b193-5174-4ad9-ac8b-9c70f552f143 req-26d5edb9-b5cb-45c2-8c09-6b62bd9643b7 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:46.389819 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-ba56b193-5174-4ad9-ac8b-9c70f552f143 req-26d5edb9-b5cb-45c2-8c09-6b62bd9643b7 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:46.402930 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-ba56b193-5174-4ad9-ac8b-9c70f552f143 req-26d5edb9-b5cb-45c2-8c09-6b62bd9643b7 service nova] Creating event network-vif-deleted:829b066e-4335-4351-899c-03b885192e39 for instance 6b0ce676-a485-4100-8afa-a6bc5efacf8f on hv-cinder-83754 Jul 18 16:58:46.408071 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-ba56b193-5174-4ad9-ac8b-9c70f552f143 req-26d5edb9-b5cb-45c2-8c09-6b62bd9643b7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030823 Jul 18 16:58:46.408671 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 485/958] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:58:46.439566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-960e710d-fd19-4cff-b3f3-965962b2bdee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:46.447293 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-960e710d-fd19-4cff-b3f3-965962b2bdee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.170452 Jul 18 16:58:46.448162 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 474/959] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:46 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:46.787951 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0a738d86-a9af-4e8a-84c5-831dd05db216 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:46.788647 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0a738d86-a9af-4e8a-84c5-831dd05db216 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:46.795042 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0a738d86-a9af-4e8a-84c5-831dd05db216 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:46.795511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0a738d86-a9af-4e8a-84c5-831dd05db216 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:46.796281 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0a738d86-a9af-4e8a-84c5-831dd05db216 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:46.796727 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0a738d86-a9af-4e8a-84c5-831dd05db216 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:46.862869 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0a738d86-a9af-4e8a-84c5-831dd05db216 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:46.870721 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0a738d86-a9af-4e8a-84c5-831dd05db216 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1467 microversion: 2.1 time: 0.087595 Jul 18 16:58:46.871283 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 486/960] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:46 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1467 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:47.241589 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a55b33a1-da02-4d63-8a44-dd31d90ee006 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:47.242197 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a55b33a1-da02-4d63-8a44-dd31d90ee006 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:47.248294 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a55b33a1-da02-4d63-8a44-dd31d90ee006 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:47.248734 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a55b33a1-da02-4d63-8a44-dd31d90ee006 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:47.249520 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a55b33a1-da02-4d63-8a44-dd31d90ee006 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:47.249984 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a55b33a1-da02-4d63-8a44-dd31d90ee006 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:47.380158 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a55b33a1-da02-4d63-8a44-dd31d90ee006 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:47.388302 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a55b33a1-da02-4d63-8a44-dd31d90ee006 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1366 microversion: 2.1 time: 0.151704 Jul 18 16:58:47.388877 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 475/961] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:47 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:47.464588 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a87cb403-4c2d-407a-a8da-9046191fd87a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:47.465226 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a87cb403-4c2d-407a-a8da-9046191fd87a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:47.471453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a87cb403-4c2d-407a-a8da-9046191fd87a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:47.471909 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a87cb403-4c2d-407a-a8da-9046191fd87a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:47.472674 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a87cb403-4c2d-407a-a8da-9046191fd87a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:47.473147 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a87cb403-4c2d-407a-a8da-9046191fd87a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:47.608044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a87cb403-4c2d-407a-a8da-9046191fd87a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:47.616596 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a87cb403-4c2d-407a-a8da-9046191fd87a tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.155155 Jul 18 16:58:47.617186 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 487/962] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:47 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:47.887704 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-421bab53-cb83-4bb8-b151-59c4d1388f99 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:47.888315 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-421bab53-cb83-4bb8-b151-59c4d1388f99 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:47.894628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-421bab53-cb83-4bb8-b151-59c4d1388f99 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:47.895087 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-421bab53-cb83-4bb8-b151-59c4d1388f99 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:47.895866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-421bab53-cb83-4bb8-b151-59c4d1388f99 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:47.896820 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-421bab53-cb83-4bb8-b151-59c4d1388f99 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:47.915532 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:48.053779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-421bab53-cb83-4bb8-b151-59c4d1388f99 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:48.053779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-421bab53-cb83-4bb8-b151-59c4d1388f99 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1467 microversion: 2.1 time: 0.082508 Jul 18 16:58:48.053779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 476/963] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:47 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1467 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:48.407116 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8f933275-3392-4571-ad4d-f4ec0494e75d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:48.407897 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8f933275-3392-4571-ad4d-f4ec0494e75d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:48.414502 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f933275-3392-4571-ad4d-f4ec0494e75d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:48.414979 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f933275-3392-4571-ad4d-f4ec0494e75d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:48.415756 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f933275-3392-4571-ad4d-f4ec0494e75d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:48.416191 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f933275-3392-4571-ad4d-f4ec0494e75d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:48.554068 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8f933275-3392-4571-ad4d-f4ec0494e75d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:48.561844 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8f933275-3392-4571-ad4d-f4ec0494e75d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1366 microversion: 2.1 time: 0.159884 Jul 18 16:58:48.562318 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 488/964] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:48 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:48.635038 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5af55c8b-15ab-47fa-b96d-dea99b3b3440 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:48.635650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5af55c8b-15ab-47fa-b96d-dea99b3b3440 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:48.643364 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5af55c8b-15ab-47fa-b96d-dea99b3b3440 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:48.643823 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5af55c8b-15ab-47fa-b96d-dea99b3b3440 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:48.644602 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5af55c8b-15ab-47fa-b96d-dea99b3b3440 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:48.645068 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5af55c8b-15ab-47fa-b96d-dea99b3b3440 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:48.785692 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5af55c8b-15ab-47fa-b96d-dea99b3b3440 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:48.794008 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5af55c8b-15ab-47fa-b96d-dea99b3b3440 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.163707 Jul 18 16:58:48.794572 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 477/965] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:48 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:49.100653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1ca5daa8-196b-4a49-95c4-b2a295d71281 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:49.100653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1ca5daa8-196b-4a49-95c4-b2a295d71281 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:49.100653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:49.100653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:49.100653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ca5daa8-196b-4a49-95c4-b2a295d71281 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:49.102256 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ca5daa8-196b-4a49-95c4-b2a295d71281 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:49.102256 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ca5daa8-196b-4a49-95c4-b2a295d71281 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:49.102256 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ca5daa8-196b-4a49-95c4-b2a295d71281 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:49.119205 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ca5daa8-196b-4a49-95c4-b2a295d71281 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:49.119716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ca5daa8-196b-4a49-95c4-b2a295d71281 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:49.120275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-1ca5daa8-196b-4a49-95c4-b2a295d71281 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lazy-loading 'fault' on Instance uuid 6b0ce676-a485-4100-8afa-a6bc5efacf8f {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:49.165033 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1ca5daa8-196b-4a49-95c4-b2a295d71281 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:49.176333 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1ca5daa8-196b-4a49-95c4-b2a295d71281 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1312 microversion: 2.1 time: 0.109659 Jul 18 16:58:49.177120 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 489/966] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:49 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:49.581441 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cfd1a18e-4f2a-47a0-bc5b-225e05b4bfb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:49.582165 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cfd1a18e-4f2a-47a0-bc5b-225e05b4bfb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:49.584907 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=6 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:49.590736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfd1a18e-4f2a-47a0-bc5b-225e05b4bfb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:49.591186 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfd1a18e-4f2a-47a0-bc5b-225e05b4bfb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:49.592020 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfd1a18e-4f2a-47a0-bc5b-225e05b4bfb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:49.592481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfd1a18e-4f2a-47a0-bc5b-225e05b4bfb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:49.731857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cfd1a18e-4f2a-47a0-bc5b-225e05b4bfb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:49.741303 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cfd1a18e-4f2a-47a0-bc5b-225e05b4bfb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1366 microversion: 2.1 time: 0.164492 Jul 18 16:58:49.741995 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 478/967] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:49 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:49.812201 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aa4905af-6c5c-4958-8194-e44cef9355e8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:49.812811 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aa4905af-6c5c-4958-8194-e44cef9355e8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:49.820676 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa4905af-6c5c-4958-8194-e44cef9355e8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:49.821156 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa4905af-6c5c-4958-8194-e44cef9355e8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:49.821929 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa4905af-6c5c-4958-8194-e44cef9355e8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:49.822365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa4905af-6c5c-4958-8194-e44cef9355e8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:49.965450 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aa4905af-6c5c-4958-8194-e44cef9355e8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:49.973209 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aa4905af-6c5c-4958-8194-e44cef9355e8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.165203 Jul 18 16:58:49.973755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 490/968] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:49 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:50.306498 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0d05e7a9-c7e4-4a2f-9343-6b9fb01ac1cf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:50.307117 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0d05e7a9-c7e4-4a2f-9343-6b9fb01ac1cf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:50.313560 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d05e7a9-c7e4-4a2f-9343-6b9fb01ac1cf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:50.314019 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d05e7a9-c7e4-4a2f-9343-6b9fb01ac1cf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:50.314792 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d05e7a9-c7e4-4a2f-9343-6b9fb01ac1cf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:50.315237 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d05e7a9-c7e4-4a2f-9343-6b9fb01ac1cf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:50.347276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d05e7a9-c7e4-4a2f-9343-6b9fb01ac1cf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:50.347725 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d05e7a9-c7e4-4a2f-9343-6b9fb01ac1cf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:50.348180 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-0d05e7a9-c7e4-4a2f-9343-6b9fb01ac1cf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lazy-loading 'fault' on Instance uuid 6b0ce676-a485-4100-8afa-a6bc5efacf8f {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:50.393058 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0d05e7a9-c7e4-4a2f-9343-6b9fb01ac1cf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:50.400724 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0d05e7a9-c7e4-4a2f-9343-6b9fb01ac1cf tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 200 len: 1312 microversion: 2.1 time: 0.099322 Jul 18 16:58:50.401460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 479/969] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:50 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:50.761328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-af8a4fa1-f492-4205-b9aa-c5b871333a31 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:50.761936 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-af8a4fa1-f492-4205-b9aa-c5b871333a31 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:50.768150 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-af8a4fa1-f492-4205-b9aa-c5b871333a31 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:50.783260 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-af8a4fa1-f492-4205-b9aa-c5b871333a31 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:50.783260 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-af8a4fa1-f492-4205-b9aa-c5b871333a31 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:50.783260 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-af8a4fa1-f492-4205-b9aa-c5b871333a31 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:50.903467 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-af8a4fa1-f492-4205-b9aa-c5b871333a31 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:50.912513 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-af8a4fa1-f492-4205-b9aa-c5b871333a31 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1366 microversion: 2.1 time: 0.154369 Jul 18 16:58:50.913101 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 491/970] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:50 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:50.991755 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-66d33c90-87c5-4e48-bbb2-a27eb6bf50ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:50.992331 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-66d33c90-87c5-4e48-bbb2-a27eb6bf50ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:50.999012 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-66d33c90-87c5-4e48-bbb2-a27eb6bf50ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:50.999462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-66d33c90-87c5-4e48-bbb2-a27eb6bf50ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:51.000219 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-66d33c90-87c5-4e48-bbb2-a27eb6bf50ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:51.000654 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-66d33c90-87c5-4e48-bbb2-a27eb6bf50ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:51.134150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-66d33c90-87c5-4e48-bbb2-a27eb6bf50ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:51.142164 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-66d33c90-87c5-4e48-bbb2-a27eb6bf50ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.154689 Jul 18 16:58:51.142726 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 480/971] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:50 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:51.416975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-44137f49-50ec-4ed7-b6a0-0354aa23471e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:51.417611 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-44137f49-50ec-4ed7-b6a0-0354aa23471e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 6b0ce676-a485-4100-8afa-a6bc5efacf8f] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:51.420625 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:51.424312 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44137f49-50ec-4ed7-b6a0-0354aa23471e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:51.424769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44137f49-50ec-4ed7-b6a0-0354aa23471e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:51.425587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44137f49-50ec-4ed7-b6a0-0354aa23471e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:51.426062 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44137f49-50ec-4ed7-b6a0-0354aa23471e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:51.440331 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-44137f49-50ec-4ed7-b6a0-0354aa23471e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] HTTP exception thrown: Instance 6b0ce676-a485-4100-8afa-a6bc5efacf8f could not be found. Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-44137f49-50ec-4ed7-b6a0-0354aa23471e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Request method failure captured: Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f HTTP/1.1 Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y-TiVRFIxQUFS3o-vF1tU9Gsir476hfPwg6-9QY-ekQJczP403moh-x5hK5fdr7Kyenyms_fsEbsImWQwwhBO-dS1lqDFJndVpqEGo5Vn-47C8Aj-o3gFI_Qx_JhbRvmzfNos5WqnfrA286SqwZvQAoPFHOJXCA-yaId_liYvjAawc Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 2e5e262f0ed548ee8a4450d0d4806667 Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:58:51.442263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:58:51.444237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:58:51.444237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:58:51.444237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 2e5e262f0ed548ee8a4450d0d4806667 Jul 18 16:58:51.444237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:58:51.444237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-ServerRescueNegativeTestJSON-1412367741-project Jul 18 16:58:51.444237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:58:51.444237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:58:51.444237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 4d27db5cdd9e453dbd93b862db694309 Jul 18 16:58:51.444237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1412367741-project Jul 18 16:58:51.444237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 16:58:51.444237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance 6b0ce676-a485-4100-8afa-a6bc5efacf8f could not be found. Jul 18 16:58:51.444237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '6b0ce676-a485-4100-8afa-a6bc5efacf8f'} Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b0ce676-a485-4100-8afa-a6bc5efacf8f could not be found. Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:58:51.445096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b0ce676-a485-4100-8afa-a6bc5efacf8f could not be found. Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b0ce676-a485-4100-8afa-a6bc5efacf8f could not be found. Jul 18 16:58:51.446365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:58:51.447484 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-44137f49-50ec-4ed7-b6a0-0354aa23471e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Returning 404 to user: Instance 6b0ce676-a485-4100-8afa-a6bc5efacf8f could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:58:51.447484 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-44137f49-50ec-4ed7-b6a0-0354aa23471e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f" status: 404 len: 111 microversion: 2.1 time: 0.031189 Jul 18 16:58:51.447484 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 492/972] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:51 2022] GET /compute/v2.1/servers/6b0ce676-a485-4100-8afa-a6bc5efacf8f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:58:51.453098 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-eee4e032-0956-4d17-ad86-dedf1f8a7d51 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:51.453642 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-eee4e032-0956-4d17-ad86-dedf1f8a7d51 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:51.460789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eee4e032-0956-4d17-ad86-dedf1f8a7d51 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:51.461264 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eee4e032-0956-4d17-ad86-dedf1f8a7d51 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:51.462025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eee4e032-0956-4d17-ad86-dedf1f8a7d51 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:51.462543 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eee4e032-0956-4d17-ad86-dedf1f8a7d51 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:51.487325 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-eee4e032-0956-4d17-ad86-dedf1f8a7d51 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:58:51.756996 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:51.930077 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a1598596-d2a4-4642-bd70-fc7497e79ae0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:51.930689 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a1598596-d2a4-4642-bd70-fc7497e79ae0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:51.937586 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1598596-d2a4-4642-bd70-fc7497e79ae0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:51.938041 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1598596-d2a4-4642-bd70-fc7497e79ae0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:51.938870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1598596-d2a4-4642-bd70-fc7497e79ae0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:51.939311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1598596-d2a4-4642-bd70-fc7497e79ae0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:51.953288 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-eee4e032-0956-4d17-ad86-dedf1f8a7d51 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "DELETE /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 204 len: 0 microversion: 2.1 time: 0.503819 Jul 18 16:58:51.953987 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 481/973] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 16:58:51 2022] DELETE /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:58:51.963468 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f8f1e471-6906-4a77-b6c6-163ffd32522a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:51.970007 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f8f1e471-6906-4a77-b6c6-163ffd32522a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:51.971187 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f8f1e471-6906-4a77-b6c6-163ffd32522a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:51.971646 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f8f1e471-6906-4a77-b6c6-163ffd32522a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:51.972675 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f8f1e471-6906-4a77-b6c6-163ffd32522a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:51.972969 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f8f1e471-6906-4a77-b6c6-163ffd32522a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:52.080096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a1598596-d2a4-4642-bd70-fc7497e79ae0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:52.088465 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a1598596-d2a4-4642-bd70-fc7497e79ae0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1366 microversion: 2.1 time: 0.163540 Jul 18 16:58:52.089295 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 493/974] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:51 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:52.110964 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f8f1e471-6906-4a77-b6c6-163ffd32522a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:52.119463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f8f1e471-6906-4a77-b6c6-163ffd32522a tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.161177 Jul 18 16:58:52.120231 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 482/975] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:51 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:52.160132 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-00f920f7-b6dc-48f4-b85f-9d138d503a65 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:52.160722 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-00f920f7-b6dc-48f4-b85f-9d138d503a65 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:52.167762 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00f920f7-b6dc-48f4-b85f-9d138d503a65 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:52.168214 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00f920f7-b6dc-48f4-b85f-9d138d503a65 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:52.169108 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00f920f7-b6dc-48f4-b85f-9d138d503a65 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:52.169546 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00f920f7-b6dc-48f4-b85f-9d138d503a65 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:52.201952 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-9b26d609-8f71-45aa-b7d0-89cf494c0731 req-bf809480-9d24-4841-929a-79392b301658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d0d7ca-fd48-4083-9569-18fb20c564a9", "name": "network-vif-plugged", "status": "completed", "tag": "3b49a420-2c47-4e76-aaed-02ecf0bb74aa"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:52.214208 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-9b26d609-8f71-45aa-b7d0-89cf494c0731 req-bf809480-9d24-4841-929a-79392b301658 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:52.214690 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-9b26d609-8f71-45aa-b7d0-89cf494c0731 req-bf809480-9d24-4841-929a-79392b301658 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:52.226783 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-9b26d609-8f71-45aa-b7d0-89cf494c0731 req-bf809480-9d24-4841-929a-79392b301658 service nova] Creating event network-vif-plugged:3b49a420-2c47-4e76-aaed-02ecf0bb74aa for instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 on hv-cinder-83754 Jul 18 16:58:52.231779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-9b26d609-8f71-45aa-b7d0-89cf494c0731 req-bf809480-9d24-4841-929a-79392b301658 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034464 Jul 18 16:58:52.232557 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 483/976] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:58:52.310771 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-00f920f7-b6dc-48f4-b85f-9d138d503a65 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:52.319047 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-00f920f7-b6dc-48f4-b85f-9d138d503a65 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.162615 Jul 18 16:58:52.319619 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 494/977] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:52 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:53.106451 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-21c70b3b-954a-4c7f-907d-f0c557005b34 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:53.107200 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-21c70b3b-954a-4c7f-907d-f0c557005b34 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:53.113973 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21c70b3b-954a-4c7f-907d-f0c557005b34 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:53.114547 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21c70b3b-954a-4c7f-907d-f0c557005b34 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:53.115685 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21c70b3b-954a-4c7f-907d-f0c557005b34 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:53.116116 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21c70b3b-954a-4c7f-907d-f0c557005b34 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:53.136785 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-958302cc-9b41-47fa-bb51-326e2cd6c6f9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:53.137461 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-958302cc-9b41-47fa-bb51-326e2cd6c6f9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:53.144167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-958302cc-9b41-47fa-bb51-326e2cd6c6f9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:53.144621 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-958302cc-9b41-47fa-bb51-326e2cd6c6f9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:53.145428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-958302cc-9b41-47fa-bb51-326e2cd6c6f9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:53.145880 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-958302cc-9b41-47fa-bb51-326e2cd6c6f9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:53.258645 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-21c70b3b-954a-4c7f-907d-f0c557005b34 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:53.266276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-21c70b3b-954a-4c7f-907d-f0c557005b34 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1366 microversion: 2.1 time: 0.164561 Jul 18 16:58:53.266858 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 484/978] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:53 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:53.287175 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-958302cc-9b41-47fa-bb51-326e2cd6c6f9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:53.294609 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-958302cc-9b41-47fa-bb51-326e2cd6c6f9 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.161803 Jul 18 16:58:53.295171 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 495/979] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:53 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:53.335769 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-95baa047-20f3-438a-8e5b-d3cb788af959 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:53.336474 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-95baa047-20f3-438a-8e5b-d3cb788af959 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:53.343064 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95baa047-20f3-438a-8e5b-d3cb788af959 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:53.343545 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95baa047-20f3-438a-8e5b-d3cb788af959 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:53.344329 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95baa047-20f3-438a-8e5b-d3cb788af959 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:53.344747 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95baa047-20f3-438a-8e5b-d3cb788af959 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:53.480428 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-95baa047-20f3-438a-8e5b-d3cb788af959 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:53.488346 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-95baa047-20f3-438a-8e5b-d3cb788af959 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.156401 Jul 18 16:58:53.489246 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 485/980] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:53 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:54.283462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-11c66c88-56b9-4971-8e8a-8a96aa514e4a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:54.284114 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-11c66c88-56b9-4971-8e8a-8a96aa514e4a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:54.291097 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11c66c88-56b9-4971-8e8a-8a96aa514e4a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:54.291567 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11c66c88-56b9-4971-8e8a-8a96aa514e4a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:54.292366 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11c66c88-56b9-4971-8e8a-8a96aa514e4a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:54.292796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11c66c88-56b9-4971-8e8a-8a96aa514e4a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:54.312101 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0318efc1-7352-4231-8a9b-421321e67401 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:54.312754 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0318efc1-7352-4231-8a9b-421321e67401 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:54.320636 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0318efc1-7352-4231-8a9b-421321e67401 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:54.321117 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0318efc1-7352-4231-8a9b-421321e67401 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:54.322276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0318efc1-7352-4231-8a9b-421321e67401 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:54.322684 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0318efc1-7352-4231-8a9b-421321e67401 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:54.431943 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-11c66c88-56b9-4971-8e8a-8a96aa514e4a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:54.439543 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-11c66c88-56b9-4971-8e8a-8a96aa514e4a tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1366 microversion: 2.1 time: 0.160032 Jul 18 16:58:54.440159 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 496/981] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:54 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:54.466892 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0318efc1-7352-4231-8a9b-421321e67401 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:54.474884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0318efc1-7352-4231-8a9b-421321e67401 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.166940 Jul 18 16:58:54.475390 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 486/982] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:54 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:54.506078 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-94a83634-482b-4dc6-8c2d-70143241dc4b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:54.506691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-94a83634-482b-4dc6-8c2d-70143241dc4b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:54.512696 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-94a83634-482b-4dc6-8c2d-70143241dc4b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:54.513189 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-94a83634-482b-4dc6-8c2d-70143241dc4b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:54.513962 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-94a83634-482b-4dc6-8c2d-70143241dc4b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:54.514413 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-94a83634-482b-4dc6-8c2d-70143241dc4b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:54.652320 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-94a83634-482b-4dc6-8c2d-70143241dc4b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:54.659905 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-94a83634-482b-4dc6-8c2d-70143241dc4b tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.158252 Jul 18 16:58:54.660497 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 497/983] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:54 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:55.457346 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-68345344-d6ff-4e8f-a647-fd001f14af78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:55.457973 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-68345344-d6ff-4e8f-a647-fd001f14af78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:55.465450 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-68345344-d6ff-4e8f-a647-fd001f14af78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:55.465907 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-68345344-d6ff-4e8f-a647-fd001f14af78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:55.466740 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-68345344-d6ff-4e8f-a647-fd001f14af78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:55.467179 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-68345344-d6ff-4e8f-a647-fd001f14af78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:55.492261 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6a0d4d58-a25b-4102-bb97-c7b977080252 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:55.492891 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6a0d4d58-a25b-4102-bb97-c7b977080252 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:55.499604 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a0d4d58-a25b-4102-bb97-c7b977080252 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:55.500063 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a0d4d58-a25b-4102-bb97-c7b977080252 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:55.500843 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a0d4d58-a25b-4102-bb97-c7b977080252 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:55.501320 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a0d4d58-a25b-4102-bb97-c7b977080252 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:55.605723 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-68345344-d6ff-4e8f-a647-fd001f14af78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:55.613484 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-68345344-d6ff-4e8f-a647-fd001f14af78 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1366 microversion: 2.1 time: 0.159990 Jul 18 16:58:55.614059 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 487/984] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:55 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:55.641041 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6a0d4d58-a25b-4102-bb97-c7b977080252 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:55.649975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6a0d4d58-a25b-4102-bb97-c7b977080252 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.161824 Jul 18 16:58:55.650535 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 498/985] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:55 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:55.678653 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3d07ce3d-9e07-4179-af38-b9ea7e91e681 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:55.679175 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3d07ce3d-9e07-4179-af38-b9ea7e91e681 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:55.685184 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d07ce3d-9e07-4179-af38-b9ea7e91e681 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:55.685631 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d07ce3d-9e07-4179-af38-b9ea7e91e681 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:55.686381 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d07ce3d-9e07-4179-af38-b9ea7e91e681 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:55.686815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d07ce3d-9e07-4179-af38-b9ea7e91e681 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:55.824425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3d07ce3d-9e07-4179-af38-b9ea7e91e681 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:55.832678 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3d07ce3d-9e07-4179-af38-b9ea7e91e681 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.158533 Jul 18 16:58:55.833346 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 488/986] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:55 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:56.630743 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c13d7e07-ad1c-40a0-9434-89e83416baeb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:56.631425 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c13d7e07-ad1c-40a0-9434-89e83416baeb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:56.637955 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c13d7e07-ad1c-40a0-9434-89e83416baeb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:56.638407 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c13d7e07-ad1c-40a0-9434-89e83416baeb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:56.639172 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c13d7e07-ad1c-40a0-9434-89e83416baeb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:56.639608 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c13d7e07-ad1c-40a0-9434-89e83416baeb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:56.643514 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:56.667387 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dafda3c5-3195-4118-8730-3a2d066d1c1e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:56.668013 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dafda3c5-3195-4118-8730-3a2d066d1c1e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:56.674846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dafda3c5-3195-4118-8730-3a2d066d1c1e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:56.675303 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dafda3c5-3195-4118-8730-3a2d066d1c1e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:56.676083 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dafda3c5-3195-4118-8730-3a2d066d1c1e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:56.676557 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dafda3c5-3195-4118-8730-3a2d066d1c1e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:56.773905 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c13d7e07-ad1c-40a0-9434-89e83416baeb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:56.781952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c13d7e07-ad1c-40a0-9434-89e83416baeb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1366 microversion: 2.1 time: 0.155833 Jul 18 16:58:56.782547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 499/987] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:56 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:56.813872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dafda3c5-3195-4118-8730-3a2d066d1c1e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:56.821931 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dafda3c5-3195-4118-8730-3a2d066d1c1e tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.158470 Jul 18 16:58:56.822492 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 489/988] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:56 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:56.850228 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2a23ebc0-b8cd-4a51-a823-a5b42a1a45ec tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:56.850837 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2a23ebc0-b8cd-4a51-a823-a5b42a1a45ec tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:56.856847 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2a23ebc0-b8cd-4a51-a823-a5b42a1a45ec tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:56.857341 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2a23ebc0-b8cd-4a51-a823-a5b42a1a45ec tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:56.859305 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2a23ebc0-b8cd-4a51-a823-a5b42a1a45ec tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:56.859305 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2a23ebc0-b8cd-4a51-a823-a5b42a1a45ec tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:57.002497 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2a23ebc0-b8cd-4a51-a823-a5b42a1a45ec tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:57.011123 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2a23ebc0-b8cd-4a51-a823-a5b42a1a45ec tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.164915 Jul 18 16:58:57.011705 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 500/989] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:56 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:57.799896 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7f604c3a-1e69-4b4c-a0bd-ae61461c97ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:57.800527 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7f604c3a-1e69-4b4c-a0bd-ae61461c97ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:57.807903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7f604c3a-1e69-4b4c-a0bd-ae61461c97ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:57.808758 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7f604c3a-1e69-4b4c-a0bd-ae61461c97ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:57.809162 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7f604c3a-1e69-4b4c-a0bd-ae61461c97ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:57.809604 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7f604c3a-1e69-4b4c-a0bd-ae61461c97ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:57.839121 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e937e0d9-9e79-4c22-a90b-4564571efa44 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:57.839719 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e937e0d9-9e79-4c22-a90b-4564571efa44 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:57.846807 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e937e0d9-9e79-4c22-a90b-4564571efa44 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:57.847258 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e937e0d9-9e79-4c22-a90b-4564571efa44 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:57.848434 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e937e0d9-9e79-4c22-a90b-4564571efa44 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:57.848878 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e937e0d9-9e79-4c22-a90b-4564571efa44 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:57.986850 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e937e0d9-9e79-4c22-a90b-4564571efa44 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:57.995929 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e937e0d9-9e79-4c22-a90b-4564571efa44 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1523 microversion: 2.1 time: 0.160669 Jul 18 16:58:57.996526 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 501/990] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:57 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:58.008797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7f604c3a-1e69-4b4c-a0bd-ae61461c97ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:58.016484 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7f604c3a-1e69-4b4c-a0bd-ae61461c97ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1366 microversion: 2.1 time: 0.220413 Jul 18 16:58:58.017209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 490/991] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:57 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:58.028540 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-88f4de39-cbe0-4bad-a339-604fef7710ee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:58.029188 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-88f4de39-cbe0-4bad-a339-604fef7710ee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:58.035230 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88f4de39-cbe0-4bad-a339-604fef7710ee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:58.035681 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88f4de39-cbe0-4bad-a339-604fef7710ee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:58.037945 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88f4de39-cbe0-4bad-a339-604fef7710ee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:58.038345 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88f4de39-cbe0-4bad-a339-604fef7710ee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:58.184112 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-88f4de39-cbe0-4bad-a339-604fef7710ee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:58.191916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-88f4de39-cbe0-4bad-a339-604fef7710ee tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.167426 Jul 18 16:58:58.192491 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 502/992] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:58 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:58.228834 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-6b683ffa-cf07-4645-a03f-3e7314a971a8 req-7a8ec5b7-fa36-4df5-9c55-b6cebb65e135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59aa6d7f-233d-4c0e-86ef-28eaba66c858", "name": "network-vif-deleted", "tag": "e3a00be0-39ee-4ade-8902-fe1a84c9ca37"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:58.237222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-6b683ffa-cf07-4645-a03f-3e7314a971a8 req-7a8ec5b7-fa36-4df5-9c55-b6cebb65e135 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:58.237604 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-6b683ffa-cf07-4645-a03f-3e7314a971a8 req-7a8ec5b7-fa36-4df5-9c55-b6cebb65e135 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:58.248328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-6b683ffa-cf07-4645-a03f-3e7314a971a8 req-7a8ec5b7-fa36-4df5-9c55-b6cebb65e135 service nova] Creating event network-vif-deleted:e3a00be0-39ee-4ade-8902-fe1a84c9ca37 for instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 on hv-cinder-83754 Jul 18 16:58:58.253454 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-6b683ffa-cf07-4645-a03f-3e7314a971a8 req-7a8ec5b7-fa36-4df5-9c55-b6cebb65e135 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028366 Jul 18 16:58:58.254026 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 491/993] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:59.013264 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3771d92a-80ef-4040-ac27-471c62b259fc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:59.013880 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3771d92a-80ef-4040-ac27-471c62b259fc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:59.020435 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3771d92a-80ef-4040-ac27-471c62b259fc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:59.021426 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3771d92a-80ef-4040-ac27-471c62b259fc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:59.022247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3771d92a-80ef-4040-ac27-471c62b259fc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:59.022681 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3771d92a-80ef-4040-ac27-471c62b259fc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:59.034292 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bd5399f1-3969-4026-823e-58594c800034 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:59.034990 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bd5399f1-3969-4026-823e-58594c800034 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:59.042503 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd5399f1-3969-4026-823e-58594c800034 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:59.042956 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd5399f1-3969-4026-823e-58594c800034 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:59.043733 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd5399f1-3969-4026-823e-58594c800034 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:59.044177 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd5399f1-3969-4026-823e-58594c800034 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:59.056820 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3771d92a-80ef-4040-ac27-471c62b259fc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:59.057295 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3771d92a-80ef-4040-ac27-471c62b259fc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:59.057746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-3771d92a-80ef-4040-ac27-471c62b259fc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lazy-loading 'fault' on Instance uuid 59aa6d7f-233d-4c0e-86ef-28eaba66c858 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:59.063195 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:59.102557 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3771d92a-80ef-4040-ac27-471c62b259fc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d27db5cdd9e453dbd93b862db694309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e5e262f0ed548ee8a4450d0d4806667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:59.110049 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3771d92a-80ef-4040-ac27-471c62b259fc tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 200 len: 1312 microversion: 2.1 time: 0.100832 Jul 18 16:58:59.114444 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 503/994] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:59 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:59.192837 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bd5399f1-3969-4026-823e-58594c800034 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:59.201231 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bd5399f1-3969-4026-823e-58594c800034 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1556 microversion: 2.1 time: 0.171103 Jul 18 16:58:59.201716 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 492/995] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:59 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:59.209972 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3be6a928-e588-4036-9bec-bbf13358bee6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:59.215611 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3be6a928-e588-4036-9bec-bbf13358bee6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:59.217186 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3be6a928-e588-4036-9bec-bbf13358bee6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:59.217858 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3be6a928-e588-4036-9bec-bbf13358bee6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:59.218639 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3be6a928-e588-4036-9bec-bbf13358bee6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:59.219138 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3be6a928-e588-4036-9bec-bbf13358bee6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:59.222538 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3faf6854-b11d-48b8-9b9a-21b7bd3226d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:59.223028 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3faf6854-b11d-48b8-9b9a-21b7bd3226d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:59.229732 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3faf6854-b11d-48b8-9b9a-21b7bd3226d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:59.230178 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3faf6854-b11d-48b8-9b9a-21b7bd3226d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:59.230942 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3faf6854-b11d-48b8-9b9a-21b7bd3226d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:59.231377 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3faf6854-b11d-48b8-9b9a-21b7bd3226d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:59.319437 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3faf6854-b11d-48b8-9b9a-21b7bd3226d7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100703 Jul 18 16:58:59.330065 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 493/996] 10.222.0.76 () {58 vars in 1274 bytes} [Mon Jul 18 16:58:59 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:58:59.368637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3be6a928-e588-4036-9bec-bbf13358bee6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:59.377309 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3be6a928-e588-4036-9bec-bbf13358bee6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.171202 Jul 18 16:58:59.378567 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 504/997] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:59 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:00.128744 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-df7f4552-9f7e-494d-9b96-6882a6211d40 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:00.130110 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-df7f4552-9f7e-494d-9b96-6882a6211d40 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] [instance: 59aa6d7f-233d-4c0e-86ef-28eaba66c858] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:00.137164 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df7f4552-9f7e-494d-9b96-6882a6211d40 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:00.137695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df7f4552-9f7e-494d-9b96-6882a6211d40 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:00.138567 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df7f4552-9f7e-494d-9b96-6882a6211d40 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:00.139096 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df7f4552-9f7e-494d-9b96-6882a6211d40 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:00.154713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-df7f4552-9f7e-494d-9b96-6882a6211d40 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] HTTP exception thrown: Instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 could not be found. Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-df7f4552-9f7e-494d-9b96-6882a6211d40 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Request method failure captured: Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 HTTP/1.1 Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-TiVRFIxQUFS3o-vF1tU9Gsir476hfPwg6-9QY-ekQJczP403moh-x5hK5fdr7Kyenyms_fsEbsImWQwwhBO-dS1lqDFJndVpqEGo5Vn-47C8Aj-o3gFI_Qx_JhbRvmzfNos5WqnfrA286SqwZvQAoPFHOJXCA-yaId_liYvjAawc Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 2e5e262f0ed548ee8a4450d0d4806667 Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 16:59:00.156650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 16:59:00.158224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2e5e262f0ed548ee8a4450d0d4806667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:59:00.158224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:59:00.158224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 2e5e262f0ed548ee8a4450d0d4806667 Jul 18 16:59:00.158224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1412367741 Jul 18 16:59:00.158224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-ServerRescueNegativeTestJSON-1412367741-project Jul 18 16:59:00.158224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 16:59:00.158224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 16:59:00.158224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 4d27db5cdd9e453dbd93b862db694309 Jul 18 16:59:00.158224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1412367741-project Jul 18 16:59:00.158224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 16:59:00.158224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 could not be found. Jul 18 16:59:00.158224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '59aa6d7f-233d-4c0e-86ef-28eaba66c858'} Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 could not be found. Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:00.159010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 could not be found. Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 could not be found. Jul 18 16:59:00.160457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:00.162622 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-df7f4552-9f7e-494d-9b96-6882a6211d40 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] Returning 404 to user: Instance 59aa6d7f-233d-4c0e-86ef-28eaba66c858 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:00.163817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-df7f4552-9f7e-494d-9b96-6882a6211d40 tempest-ServerRescueNegativeTestJSON-1412367741 tempest-ServerRescueNegativeTestJSON-1412367741-project] 10.222.0.76 "GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858" status: 404 len: 111 microversion: 2.1 time: 0.039391 Jul 18 16:59:00.164569 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 494/998] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:00 2022] GET /compute/v2.1/servers/59aa6d7f-233d-4c0e-86ef-28eaba66c858 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:59:00.395905 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ecf5235e-2b1c-476b-85a8-e7f699cb7675 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:00.396871 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ecf5235e-2b1c-476b-85a8-e7f699cb7675 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:00.403884 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecf5235e-2b1c-476b-85a8-e7f699cb7675 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:00.404434 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecf5235e-2b1c-476b-85a8-e7f699cb7675 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:00.405353 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecf5235e-2b1c-476b-85a8-e7f699cb7675 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:00.405895 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecf5235e-2b1c-476b-85a8-e7f699cb7675 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:00.544870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ecf5235e-2b1c-476b-85a8-e7f699cb7675 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:00.553297 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ecf5235e-2b1c-476b-85a8-e7f699cb7675 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.161324 Jul 18 16:59:00.553867 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 505/999] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:00 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:00.878720 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-ffb63132-aeb7-4980-9537-82d12b54bb5d req-4e2c00b8-41af-4bd8-955e-3ed7925512c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d0d7ca-fd48-4083-9569-18fb20c564a9", "tag": "3b49a420-2c47-4e76-aaed-02ecf0bb74aa"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:00.897268 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-ffb63132-aeb7-4980-9537-82d12b54bb5d req-4e2c00b8-41af-4bd8-955e-3ed7925512c9 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:00.898017 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-ffb63132-aeb7-4980-9537-82d12b54bb5d req-4e2c00b8-41af-4bd8-955e-3ed7925512c9 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:00.916323 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-ffb63132-aeb7-4980-9537-82d12b54bb5d req-4e2c00b8-41af-4bd8-955e-3ed7925512c9 service nova] Creating event network-changed:3b49a420-2c47-4e76-aaed-02ecf0bb74aa for instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 on hv-cinder-83754 Jul 18 16:59:00.923103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-ffb63132-aeb7-4980-9537-82d12b54bb5d req-4e2c00b8-41af-4bd8-955e-3ed7925512c9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050340 Jul 18 16:59:00.924185 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 495/1000] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:01.572517 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ac4f97c6-f889-47ae-b9a8-f756689584b9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:01.573288 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ac4f97c6-f889-47ae-b9a8-f756689584b9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:01.581052 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac4f97c6-f889-47ae-b9a8-f756689584b9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:01.581519 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac4f97c6-f889-47ae-b9a8-f756689584b9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:01.582312 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac4f97c6-f889-47ae-b9a8-f756689584b9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:01.582754 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac4f97c6-f889-47ae-b9a8-f756689584b9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:01.746294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ac4f97c6-f889-47ae-b9a8-f756689584b9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:01.754907 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ac4f97c6-f889-47ae-b9a8-f756689584b9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.187349 Jul 18 16:59:01.756959 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 506/1001] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:01 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:02.327051 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-75d5f74b-c85f-4b59-8103-8367b2e6b86b req-ee6abeea-35a7-4fc5-b039-e3ebcd806d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d25fa4-9505-4471-a0be-e3a486297f2d", "name": "network-vif-plugged", "status": "completed", "tag": "f3c39284-35e1-4778-990a-0024c4b94641"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:02.337319 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-75d5f74b-c85f-4b59-8103-8367b2e6b86b req-ee6abeea-35a7-4fc5-b039-e3ebcd806d71 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:02.337796 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-75d5f74b-c85f-4b59-8103-8367b2e6b86b req-ee6abeea-35a7-4fc5-b039-e3ebcd806d71 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:02.356154 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-75d5f74b-c85f-4b59-8103-8367b2e6b86b req-ee6abeea-35a7-4fc5-b039-e3ebcd806d71 service nova] Creating event network-vif-plugged:f3c39284-35e1-4778-990a-0024c4b94641 for instance 87d25fa4-9505-4471-a0be-e3a486297f2d on hv-cinder-83754 Jul 18 16:59:02.367429 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-75d5f74b-c85f-4b59-8103-8367b2e6b86b req-ee6abeea-35a7-4fc5-b039-e3ebcd806d71 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044771 Jul 18 16:59:02.368297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 496/1002] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:02.777085 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-70880ad5-a6c4-410f-965e-fcb2de05a0d6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:02.777874 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-70880ad5-a6c4-410f-965e-fcb2de05a0d6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:02.784607 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-70880ad5-a6c4-410f-965e-fcb2de05a0d6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:02.785088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-70880ad5-a6c4-410f-965e-fcb2de05a0d6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:02.785866 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-70880ad5-a6c4-410f-965e-fcb2de05a0d6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:02.786802 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-70880ad5-a6c4-410f-965e-fcb2de05a0d6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:02.937456 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-70880ad5-a6c4-410f-965e-fcb2de05a0d6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:02.946466 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-70880ad5-a6c4-410f-965e-fcb2de05a0d6 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.174958 Jul 18 16:59:02.947117 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 507/1003] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:02 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:03.965423 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9a24d36d-be3c-4acc-9151-b8676bcd5d54 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:03.966126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9a24d36d-be3c-4acc-9151-b8676bcd5d54 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:03.972706 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a24d36d-be3c-4acc-9151-b8676bcd5d54 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:03.973198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a24d36d-be3c-4acc-9151-b8676bcd5d54 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:03.974569 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a24d36d-be3c-4acc-9151-b8676bcd5d54 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:03.975436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a24d36d-be3c-4acc-9151-b8676bcd5d54 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:04.132992 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9a24d36d-be3c-4acc-9151-b8676bcd5d54 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:04.143071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9a24d36d-be3c-4acc-9151-b8676bcd5d54 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.182282 Jul 18 16:59:04.153812 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 497/1004] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:03 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:05.161124 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-244d764d-0e08-4395-afd5-417da99a6f78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:05.162799 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-244d764d-0e08-4395-afd5-417da99a6f78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:05.172623 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-244d764d-0e08-4395-afd5-417da99a6f78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:05.179942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-244d764d-0e08-4395-afd5-417da99a6f78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:05.179942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-244d764d-0e08-4395-afd5-417da99a6f78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:05.179942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-244d764d-0e08-4395-afd5-417da99a6f78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:05.320259 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-244d764d-0e08-4395-afd5-417da99a6f78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:05.327986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-244d764d-0e08-4395-afd5-417da99a6f78 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1574 microversion: 2.1 time: 0.170744 Jul 18 16:59:05.328563 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 508/1005] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:05 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:06.345396 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-03bc2dca-34ce-42f5-b1a5-84c8584ca5c5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:06.346064 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-03bc2dca-34ce-42f5-b1a5-84c8584ca5c5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:06.352753 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-03bc2dca-34ce-42f5-b1a5-84c8584ca5c5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:06.353245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-03bc2dca-34ce-42f5-b1a5-84c8584ca5c5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:06.354010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-03bc2dca-34ce-42f5-b1a5-84c8584ca5c5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:06.354445 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-03bc2dca-34ce-42f5-b1a5-84c8584ca5c5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:06.494567 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-03bc2dca-34ce-42f5-b1a5-84c8584ca5c5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:06.502064 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-03bc2dca-34ce-42f5-b1a5-84c8584ca5c5 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1561 microversion: 2.1 time: 0.160768 Jul 18 16:59:06.502626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 498/1006] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:06 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:07.161725 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f6c3f4f3-3976-4d6e-b968-e7b6d2ca5ad6 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Action: 'create', calling method: .version_select at 0x7f4af16e01f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1620470967"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:07.909267 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f6c3f4f3-3976-4d6e-b968-e7b6d2ca5ad6 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.896597 Jul 18 16:59:07.909988 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 509/1007] 10.222.0.76 () {60 vars in 1154 bytes} [Mon Jul 18 16:59:07 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 898 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 16:59:07.921358 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-03bec1b0-8ce0-4f58-9350-9ab84a7aa4f4 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af29f8a60>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:07.971039 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-03bec1b0-8ce0-4f58-9350-9ab84a7aa4f4 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae" status: 200 len: 345 microversion: 2.1 time: 0.053430 Jul 18 16:59:07.971611 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 499/1008] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 16:59:07 2022] GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:08.983750 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0e1ca501-63b9-42b6-ae47-f1f533322513 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af1645ca0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:09.030786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0e1ca501-63b9-42b6-ae47-f1f533322513 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae" status: 200 len: 345 microversion: 2.1 time: 0.051305 Jul 18 16:59:09.031354 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 510/1009] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 16:59:08 2022] GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:10.044348 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d6437a6b-24ab-43cf-b3b4-8cc171edb166 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af162cf70>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:10.091156 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d6437a6b-24ab-43cf-b3b4-8cc171edb166 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae" status: 200 len: 346 microversion: 2.1 time: 0.051096 Jul 18 16:59:10.091722 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 500/1010] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 16:59:10 2022] GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:10.103482 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3c305ca1-7915-4eca-8d34-08b7c426c197 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Action: 'create', calling method: .version_select at 0x7f4af1738670>, body: {"snapshot": {"volume_id": "63779a2b-898b-4448-b600-03bd9ea815ae", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2089512593"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:10.569498 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3c305ca1-7915-4eca-8d34-08b7c426c197 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.469572 Jul 18 16:59:10.570309 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 511/1011] 10.222.0.76 () {60 vars in 1161 bytes} [Mon Jul 18 16:59:10 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:10.581506 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-94d51409-9d67-4cb6-81f3-2416bfafbe3a tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af171f280>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:10.614552 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-94d51409-9d67-4cb6-81f3-2416bfafbe3a tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e" status: 200 len: 287 microversion: 2.1 time: 0.037649 Jul 18 16:59:10.615121 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 501/1012] 10.222.0.76 () {58 vars in 1250 bytes} [Mon Jul 18 16:59:10 2022] GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:10.625853 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-66b80ac6-9f8e-44bd-ad11-cc37db0cd853 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af1691dc0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:10.655750 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-66b80ac6-9f8e-44bd-ad11-cc37db0cd853 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033777 Jul 18 16:59:10.656323 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 512/1013] 10.222.0.76 () {58 vars in 1139 bytes} [Mon Jul 18 16:59:10 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:10.666708 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d33a9e40-6fef-4f90-a0ca-10a97d2d770e tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af162c1f0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:10.698055 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d33a9e40-6fef-4f90-a0ca-10a97d2d770e tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e" status: 200 len: 287 microversion: 2.1 time: 0.035336 Jul 18 16:59:10.701051 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 502/1014] 10.222.0.76 () {58 vars in 1250 bytes} [Mon Jul 18 16:59:10 2022] GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:11.711380 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-60004850-9148-4abc-bf25-514f8ae228b7 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af16d3280>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:11.741372 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-60004850-9148-4abc-bf25-514f8ae228b7 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e" status: 200 len: 287 microversion: 2.1 time: 0.034727 Jul 18 16:59:11.741942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 513/1015] 10.222.0.76 () {58 vars in 1250 bytes} [Mon Jul 18 16:59:11 2022] GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:12.753753 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b32fbbd8-87fb-43e5-8c30-3a19a52d980b tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af16ce310>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:12.786632 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b32fbbd8-87fb-43e5-8c30-3a19a52d980b tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e" status: 200 len: 287 microversion: 2.1 time: 0.037436 Jul 18 16:59:12.787209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 503/1016] 10.222.0.76 () {58 vars in 1250 bytes} [Mon Jul 18 16:59:12 2022] GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:13.799434 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f0ec92a2-784a-4b16-ae4a-81a70af39545 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af16abd30>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:13.844217 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f0ec92a2-784a-4b16-ae4a-81a70af39545 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e" status: 200 len: 287 microversion: 2.1 time: 0.036189 Jul 18 16:59:13.844217 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 514/1017] 10.222.0.76 () {58 vars in 1250 bytes} [Mon Jul 18 16:59:13 2022] GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:14.844998 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8d9f2d21-8424-4a40-ad2a-6ef7617fbc2a tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af171f5e0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:14.876657 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8d9f2d21-8424-4a40-ad2a-6ef7617fbc2a tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e" status: 200 len: 287 microversion: 2.1 time: 0.036172 Jul 18 16:59:14.877251 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 504/1018] 10.222.0.76 () {58 vars in 1250 bytes} [Mon Jul 18 16:59:14 2022] GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:15.886383 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=34 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:15.887196 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=60 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:15.891019 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0ea650dc-0ba6-4452-b713-bffdc36017e0 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af16e0ee0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:15.920477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0ea650dc-0ba6-4452-b713-bffdc36017e0 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e" status: 200 len: 288 microversion: 2.1 time: 0.035200 Jul 18 16:59:15.921076 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 515/1019] 10.222.0.76 () {58 vars in 1250 bytes} [Mon Jul 18 16:59:15 2022] GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:15.934657 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a1cb67f5-b7f4-4a8e-94b5-f0e07f1135cb tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af29f8550>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:16.096680 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a1cb67f5-b7f4-4a8e-94b5-f0e07f1135cb tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "DELETE /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e" status: 202 len: 0 microversion: 2.1 time: 0.166302 Jul 18 16:59:16.097323 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 505/1020] 10.222.0.76 () {58 vars in 1253 bytes} [Mon Jul 18 16:59:15 2022] DELETE /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:59:16.106299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-31b83b34-8528-4fe2-b446-f753c43f9684 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af17214c0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:16.136858 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-31b83b34-8528-4fe2-b446-f753c43f9684 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e" status: 200 len: 287 microversion: 2.1 time: 0.034647 Jul 18 16:59:16.137388 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 516/1021] 10.222.0.76 () {58 vars in 1250 bytes} [Mon Jul 18 16:59:16 2022] GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:17.145262 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=34 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:17.146291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=24 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:17.151035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e47131af-0e18-487c-af2a-19a942d2f2e9 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af1525670>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:17.176934 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-e47131af-0e18-487c-af2a-19a942d2f2e9 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] HTTP exception thrown: Snapshot 56479754-6b55-4a24-89c5-7cf63537d50e could not be found. Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e47131af-0e18-487c-af2a-19a942d2f2e9 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Request method failure captured: Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e HTTP/1.1 Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1ZFasXpFtc6R0Ai9zrvTDrbErB_Sn99QPYXJUrI029kJpM4OwbkF-vU2I-9XG9Ve405-M6GgRrWwni694SuPgwq5vbVvfh2JQ74ebA17ja5KqjM5lk-4vtTxlAGdz9vdb6VOQD5fG2p4qFeaQ2-xfLQOpulcyoTm9ISG4REFxp7N02E Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: fbf0d5ecebc44142a4cb2428f005cc74 Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2069828738 Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 16:59:17.180167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 16:59:17.181906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:59:17.181906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2069828738 Jul 18 16:59:17.181906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: fbf0d5ecebc44142a4cb2428f005cc74 Jul 18 16:59:17.181906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2069828738 Jul 18 16:59:17.181906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesSnapshotsTestJSON-2069828738-project Jul 18 16:59:17.181906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 16:59:17.181906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 16:59:17.181906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 43ed3a04e3ab4c9eb2b8b92af1613a32 Jul 18 16:59:17.181906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2069828738-project Jul 18 16:59:17.181906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: Jul 18 16:59:17.181906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Snapshot 56479754-6b55-4a24-89c5-7cf63537d50e could not be found. Jul 18 16:59:17.181906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '56479754-6b55-4a24-89c5-7cf63537d50e'} Jul 18 16:59:17.181906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 56479754-6b55-4a24-89c5-7cf63537d50e could not be found. (HTTP 404) (Request-ID: req-690d0264-2e89-45e6-a600-1aa92827879d) Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:17.182844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:59:17.184209 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 56479754-6b55-4a24-89c5-7cf63537d50e could not be found. Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 16:59:17.185633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:59:17.187025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 56479754-6b55-4a24-89c5-7cf63537d50e could not be found. Jul 18 16:59:17.187025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:17.187025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:17.187025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:17.187025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:17.187025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:17.187025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:17.187025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:59:17.187025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:59:17.187025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 56479754-6b55-4a24-89c5-7cf63537d50e could not be found. Jul 18 16:59:17.187025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:17.187025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e47131af-0e18-487c-af2a-19a942d2f2e9 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Returning 404 to user: Snapshot 56479754-6b55-4a24-89c5-7cf63537d50e could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:17.187025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e47131af-0e18-487c-af2a-19a942d2f2e9 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e" status: 404 len: 111 microversion: 2.1 time: 0.037361 Jul 18 16:59:17.188042 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 506/1022] 10.222.0.76 () {58 vars in 1250 bytes} [Mon Jul 18 16:59:17 2022] GET /compute/v2.1/os-snapshots/56479754-6b55-4a24-89c5-7cf63537d50e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:59:17.191177 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c33874e0-1cd5-4418-8728-87ef6c494cdb tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af1691d30>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:17.387267 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c33874e0-1cd5-4418-8728-87ef6c494cdb tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae" status: 202 len: 0 microversion: 2.1 time: 0.200561 Jul 18 16:59:17.387901 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 517/1023] 10.222.0.76 () {58 vars in 1247 bytes} [Mon Jul 18 16:59:17 2022] DELETE /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:59:17.396473 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bb8cad9b-cd42-4580-8c66-76768ca5619a tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af1433a60>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:17.446349 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bb8cad9b-cd42-4580-8c66-76768ca5619a tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae" status: 200 len: 345 microversion: 2.1 time: 0.054042 Jul 18 16:59:17.446922 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 507/1024] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 16:59:17 2022] GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:18.460662 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f13a9a67-df0a-4fc4-a219-10d88f71d3d5 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af16e0940>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:18.489541 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-f13a9a67-df0a-4fc4-a219-10d88f71d3d5 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] HTTP exception thrown: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f13a9a67-df0a-4fc4-a219-10d88f71d3d5 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Request method failure captured: Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae HTTP/1.1 Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1ZFasXpFtc6R0Ai9zrvTDrbErB_Sn99QPYXJUrI029kJpM4OwbkF-vU2I-9XG9Ve405-M6GgRrWwni694SuPgwq5vbVvfh2JQ74ebA17ja5KqjM5lk-4vtTxlAGdz9vdb6VOQD5fG2p4qFeaQ2-xfLQOpulcyoTm9ISG4REFxp7N02E Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: fbf0d5ecebc44142a4cb2428f005cc74 Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2069828738 Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:59:18.493581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:59:18.495167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:59:18.495167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2069828738 Jul 18 16:59:18.495167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: fbf0d5ecebc44142a4cb2428f005cc74 Jul 18 16:59:18.495167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2069828738 Jul 18 16:59:18.495167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-VolumesSnapshotsTestJSON-2069828738-project Jul 18 16:59:18.495167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:59:18.495167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:59:18.495167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 43ed3a04e3ab4c9eb2b8b92af1613a32 Jul 18 16:59:18.495167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2069828738-project Jul 18 16:59:18.495167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: Jul 18 16:59:18.495167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.495167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '63779a2b-898b-4448-b600-03bd9ea815ae'} Jul 18 16:59:18.495167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. (HTTP 404) (Request-ID: req-bfa528f2-23d8-455a-91d9-032a97e0cd6e) Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:18.496140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:59:18.497585 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:59:18.499013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f13a9a67-df0a-4fc4-a219-10d88f71d3d5 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Returning 404 to user: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f13a9a67-df0a-4fc4-a219-10d88f71d3d5 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae" status: 404 len: 109 microversion: 2.1 time: 0.039159 Jul 18 16:59:18.500278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 518/1025] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 16:59:18 2022] GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:59:18.504955 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-66634fed-d69b-4827-b006-b87ad9fb59f3 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af154a5e0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:18.533529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-66634fed-d69b-4827-b006-b87ad9fb59f3 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] HTTP exception thrown: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-66634fed-d69b-4827-b006-b87ad9fb59f3 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Request method failure captured: Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae HTTP/1.1 Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1ZFasXpFtc6R0Ai9zrvTDrbErB_Sn99QPYXJUrI029kJpM4OwbkF-vU2I-9XG9Ve405-M6GgRrWwni694SuPgwq5vbVvfh2JQ74ebA17ja5KqjM5lk-4vtTxlAGdz9vdb6VOQD5fG2p4qFeaQ2-xfLQOpulcyoTm9ISG4REFxp7N02E Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: fbf0d5ecebc44142a4cb2428f005cc74 Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2069828738 Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 16:59:18.535448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 16:59:18.537126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:59:18.537126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2069828738 Jul 18 16:59:18.537126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: fbf0d5ecebc44142a4cb2428f005cc74 Jul 18 16:59:18.537126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2069828738 Jul 18 16:59:18.537126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesSnapshotsTestJSON-2069828738-project Jul 18 16:59:18.537126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 16:59:18.537126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 16:59:18.537126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 43ed3a04e3ab4c9eb2b8b92af1613a32 Jul 18 16:59:18.537126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2069828738-project Jul 18 16:59:18.537126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: Jul 18 16:59:18.537126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.537126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '63779a2b-898b-4448-b600-03bd9ea815ae'} Jul 18 16:59:18.537126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. (HTTP 404) (Request-ID: req-81da293a-6991-4299-b8b0-868780713817) Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:18.538460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:59:18.539814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 16:59:18.540940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:59:18.542435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.542435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.542435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:18.542435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.542435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:18.542435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:18.542435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:18.542435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:59:18.542435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:59:18.542435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.542435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.542435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-66634fed-d69b-4827-b006-b87ad9fb59f3 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Returning 404 to user: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:18.542435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-66634fed-d69b-4827-b006-b87ad9fb59f3 tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae" status: 404 len: 109 microversion: 2.1 time: 0.035883 Jul 18 16:59:18.543804 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 508/1026] 10.222.0.76 () {58 vars in 1247 bytes} [Mon Jul 18 16:59:18 2022] DELETE /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:59:18.546065 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-baf03f43-7c38-4e3e-8bf8-c56f374f965f tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Calling method '.version_select at 0x7f4af16ec820>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:18.577432 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-baf03f43-7c38-4e3e-8bf8-c56f374f965f tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] HTTP exception thrown: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-baf03f43-7c38-4e3e-8bf8-c56f374f965f tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Request method failure captured: Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae HTTP/1.1 Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1ZFasXpFtc6R0Ai9zrvTDrbErB_Sn99QPYXJUrI029kJpM4OwbkF-vU2I-9XG9Ve405-M6GgRrWwni694SuPgwq5vbVvfh2JQ74ebA17ja5KqjM5lk-4vtTxlAGdz9vdb6VOQD5fG2p4qFeaQ2-xfLQOpulcyoTm9ISG4REFxp7N02E Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: fbf0d5ecebc44142a4cb2428f005cc74 Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2069828738 Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:59:18.579429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:59:18.580960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbf0d5ecebc44142a4cb2428f005cc74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:59:18.580960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2069828738 Jul 18 16:59:18.580960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: fbf0d5ecebc44142a4cb2428f005cc74 Jul 18 16:59:18.580960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2069828738 Jul 18 16:59:18.580960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-VolumesSnapshotsTestJSON-2069828738-project Jul 18 16:59:18.580960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:59:18.580960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:59:18.580960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 43ed3a04e3ab4c9eb2b8b92af1613a32 Jul 18 16:59:18.580960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2069828738-project Jul 18 16:59:18.580960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: Jul 18 16:59:18.580960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.580960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '63779a2b-898b-4448-b600-03bd9ea815ae'} Jul 18 16:59:18.580960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. (HTTP 404) (Request-ID: req-503d2d50-b848-4684-a276-dbe1a12b7f2d) Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:18.582004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:59:18.583460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:59:18.585653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-baf03f43-7c38-4e3e-8bf8-c56f374f965f tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] Returning 404 to user: Volume 63779a2b-898b-4448-b600-03bd9ea815ae could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-baf03f43-7c38-4e3e-8bf8-c56f374f965f tempest-VolumesSnapshotsTestJSON-2069828738 tempest-VolumesSnapshotsTestJSON-2069828738-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae" status: 404 len: 109 microversion: 2.1 time: 0.038825 Jul 18 16:59:18.587044 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 519/1027] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 16:59:18 2022] GET /compute/v2.1/os-volumes/63779a2b-898b-4448-b600-03bd9ea815ae => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:59:21.061745 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9e4342e0-12a5-4b2a-9c89-c5854868ac1d tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Action: 'create', calling method: .version_select at 0x7f4af14334c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1023535184", "metadata": {"Type": "work"}}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9e4342e0-12a5-4b2a-9c89-c5854868ac1d tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Request method failure captured: Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 122 Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1ZFo8QKX2gW0cG5WMuO6c1zmrXi2_WQEr0GNUEIbou5LJcSok1sIvMA3KB-OfhwWlQWTFSLJzHczIjyOnSTnTj_7WBBr4e6E1lJZSRciplBszSZh_NRERYermdSVFxplnVx_JzLN8swYM2zD-d7HGGjC75UDdE7btyq1-v6Zfrb4P_s Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 5fd9fdac59f84165968e8fea0aa8cecf Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 16:59:21.094515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 16:59:21.096718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:59:21.096718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.096718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 5fd9fdac59f84165968e8fea0aa8cecf Jul 18 16:59:21.096718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.096718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesNegativeTest-1435611437-project Jul 18 16:59:21.096718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 16:59:21.096718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 16:59:21.096718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 3788a5f76e9442268b73fc2cd17a5a15 Jul 18 16:59:21.096718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesNegativeTest-1435611437-project Jul 18 16:59:21.096718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Jul 18 16:59:21.096718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1023535184", "metadata": {"Type": "work"}}} Jul 18 16:59:21.096718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: Jul 18 16:59:21.096718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1023535184', 'metadata': {'Type': 'work'}}}} Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise error Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:21.101189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 16:59:21.102906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 16:59:21.104328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 16:59:21.104328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.104328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9e4342e0-12a5-4b2a-9c89-c5854868ac1d tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:21.104328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9e4342e0-12a5-4b2a-9c89-c5854868ac1d tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.150757 Jul 18 16:59:21.104328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 509/1028] 10.222.0.76 () {60 vars in 1155 bytes} [Mon Jul 18 16:59:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 16:59:21.106115 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d4ea9657-7297-48a8-8135-0c9fc1d270fe tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Action: 'create', calling method: .version_select at 0x7f4af17388b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1303832389", "metadata": {"Type": "work"}}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d4ea9657-7297-48a8-8135-0c9fc1d270fe tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Request method failure captured: Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 120 Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1ZFo8QKX2gW0cG5WMuO6c1zmrXi2_WQEr0GNUEIbou5LJcSok1sIvMA3KB-OfhwWlQWTFSLJzHczIjyOnSTnTj_7WBBr4e6E1lJZSRciplBszSZh_NRERYermdSVFxplnVx_JzLN8swYM2zD-d7HGGjC75UDdE7btyq1-v6Zfrb4P_s Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 5fd9fdac59f84165968e8fea0aa8cecf Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:59:21.109477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:59:21.111009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:59:21.111009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.111009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 5fd9fdac59f84165968e8fea0aa8cecf Jul 18 16:59:21.111009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.111009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-VolumesNegativeTest-1435611437-project Jul 18 16:59:21.111009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:59:21.111009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:59:21.111009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 3788a5f76e9442268b73fc2cd17a5a15 Jul 18 16:59:21.111009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-VolumesNegativeTest-1435611437-project Jul 18 16:59:21.111009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Jul 18 16:59:21.111009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1303832389", "metadata": {"Type": "work"}}} Jul 18 16:59:21.111009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: Jul 18 16:59:21.111009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1303832389', 'metadata': {'Type': 'work'}}}} Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise error Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi '0' Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:21.112324 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 16:59:21.113952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 16:59:21.115218 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 16:59:21.115218 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.115218 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d4ea9657-7297-48a8-8135-0c9fc1d270fe tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:21.115218 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d4ea9657-7297-48a8-8135-0c9fc1d270fe tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008548 Jul 18 16:59:21.115218 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 520/1029] 10.222.0.76 () {60 vars in 1155 bytes} [Mon Jul 18 16:59:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:59:21.121684 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3e392ef1-c397-4d70-a21e-720c2e8a7cb8 tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Action: 'create', calling method: .version_select at 0x7f4af1722160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1634398943", "metadata": {"Type": "work"}}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3e392ef1-c397-4d70-a21e-720c2e8a7cb8 tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Request method failure captured: Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 119 Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1ZFo8QKX2gW0cG5WMuO6c1zmrXi2_WQEr0GNUEIbou5LJcSok1sIvMA3KB-OfhwWlQWTFSLJzHczIjyOnSTnTj_7WBBr4e6E1lJZSRciplBszSZh_NRERYermdSVFxplnVx_JzLN8swYM2zD-d7HGGjC75UDdE7btyq1-v6Zfrb4P_s Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 5fd9fdac59f84165968e8fea0aa8cecf Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 16:59:21.123966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 16:59:21.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:59:21.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 5fd9fdac59f84165968e8fea0aa8cecf Jul 18 16:59:21.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesNegativeTest-1435611437-project Jul 18 16:59:21.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 16:59:21.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 16:59:21.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 3788a5f76e9442268b73fc2cd17a5a15 Jul 18 16:59:21.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesNegativeTest-1435611437-project Jul 18 16:59:21.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Jul 18 16:59:21.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1634398943", "metadata": {"Type": "work"}}} Jul 18 16:59:21.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: Jul 18 16:59:21.125483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1634398943', 'metadata': {'Type': 'work'}}}} Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise error Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi '' Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:21.126471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 16:59:21.128071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 16:59:21.129431 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 16:59:21.129431 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.129431 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3e392ef1-c397-4d70-a21e-720c2e8a7cb8 tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:21.129431 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3e392ef1-c397-4d70-a21e-720c2e8a7cb8 tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007447 Jul 18 16:59:21.129431 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 510/1030] 10.222.0.76 () {60 vars in 1155 bytes} [Mon Jul 18 16:59:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:59:21.135669 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-807164ca-d76e-48e0-af1e-7af8e1ac03df tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Calling method '.version_select at 0x7f4af5e22670>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:21.182618 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-807164ca-d76e-48e0-af1e-7af8e1ac03df tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] HTTP exception thrown: Volume tempest-invalid-1807314228 could not be found. Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-807164ca-d76e-48e0-af1e-7af8e1ac03df tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Request method failure captured: Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1807314228 HTTP/1.1 Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1ZFo8QKX2gW0cG5WMuO6c1zmrXi2_WQEr0GNUEIbou5LJcSok1sIvMA3KB-OfhwWlQWTFSLJzHczIjyOnSTnTj_7WBBr4e6E1lJZSRciplBszSZh_NRERYermdSVFxplnVx_JzLN8swYM2zD-d7HGGjC75UDdE7btyq1-v6Zfrb4P_s Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 5fd9fdac59f84165968e8fea0aa8cecf Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:59:21.184948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:59:21.186648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:59:21.186648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.186648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 5fd9fdac59f84165968e8fea0aa8cecf Jul 18 16:59:21.186648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.186648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-VolumesNegativeTest-1435611437-project Jul 18 16:59:21.186648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:59:21.186648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:59:21.186648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 3788a5f76e9442268b73fc2cd17a5a15 Jul 18 16:59:21.186648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-VolumesNegativeTest-1435611437-project Jul 18 16:59:21.186648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: Jul 18 16:59:21.186648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Volume tempest-invalid-1807314228 could not be found. Jul 18 16:59:21.186648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': 'tempest-invalid-1807314228'} Jul 18 16:59:21.186648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1807314228 could not be found. (HTTP 404) (Request-ID: req-db2aca42-297f-44a8-8c2a-a14358826e91) Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.187507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:59:21.188829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1807314228 could not be found. Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:59:21.190232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1807314228 could not be found. Jul 18 16:59:21.191716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.191716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.191716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.191716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.191716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.191716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.191716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:59:21.191716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:59:21.191716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1807314228 could not be found. Jul 18 16:59:21.191716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.191716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-807164ca-d76e-48e0-af1e-7af8e1ac03df tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Returning 404 to user: Volume tempest-invalid-1807314228 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:21.191716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-807164ca-d76e-48e0-af1e-7af8e1ac03df tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1807314228" status: 404 len: 99 microversion: 2.1 time: 0.055757 Jul 18 16:59:21.191716 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 521/1031] 10.222.0.76 () {58 vars in 1217 bytes} [Mon Jul 18 16:59:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1807314228 => generated 99 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 16:59:21.198252 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-89a38ecf-45f9-43f0-822a-d8d3d768dd1c tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005271 Jul 18 16:59:21.198775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 511/1032] 10.222.0.76 () {58 vars in 1139 bytes} [Mon Jul 18 16:59:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 16:59:21.207906 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4744e7bf-d8fa-440d-a16c-48163c91b64d tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003903 Jul 18 16:59:21.208417 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 522/1033] 10.222.0.76 () {58 vars in 1136 bytes} [Mon Jul 18 16:59:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 16:59:21.218067 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-07489f29-3abd-4983-84a9-b1132cf72b0a tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Calling method '.version_select at 0x7f4af17223a0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:21.250690 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-07489f29-3abd-4983-84a9-b1132cf72b0a tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] HTTP exception thrown: Volume 794669fb-c6e7-4341-bb5a-092ef5bdbd47 could not be found. Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-07489f29-3abd-4983-84a9-b1132cf72b0a tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Request method failure captured: Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/os-volumes/794669fb-c6e7-4341-bb5a-092ef5bdbd47 HTTP/1.1 Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1ZFo8QKX2gW0cG5WMuO6c1zmrXi2_WQEr0GNUEIbou5LJcSok1sIvMA3KB-OfhwWlQWTFSLJzHczIjyOnSTnTj_7WBBr4e6E1lJZSRciplBszSZh_NRERYermdSVFxplnVx_JzLN8swYM2zD-d7HGGjC75UDdE7btyq1-v6Zfrb4P_s Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 5fd9fdac59f84165968e8fea0aa8cecf Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 16:59:21.252643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 16:59:21.255035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:59:21.255035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.255035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 5fd9fdac59f84165968e8fea0aa8cecf Jul 18 16:59:21.255035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.255035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesNegativeTest-1435611437-project Jul 18 16:59:21.255035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 16:59:21.255035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 16:59:21.255035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 3788a5f76e9442268b73fc2cd17a5a15 Jul 18 16:59:21.255035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesNegativeTest-1435611437-project Jul 18 16:59:21.255035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: Jul 18 16:59:21.255035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Volume 794669fb-c6e7-4341-bb5a-092ef5bdbd47 could not be found. Jul 18 16:59:21.255035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '794669fb-c6e7-4341-bb5a-092ef5bdbd47'} Jul 18 16:59:21.255035 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 794669fb-c6e7-4341-bb5a-092ef5bdbd47 could not be found. (HTTP 404) (Request-ID: req-32612311-d8b3-4fe3-bf00-f3a1fbcd7032) Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.257061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:59:21.259597 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 794669fb-c6e7-4341-bb5a-092ef5bdbd47 could not be found. Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 16:59:21.262003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 794669fb-c6e7-4341-bb5a-092ef5bdbd47 could not be found. Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 794669fb-c6e7-4341-bb5a-092ef5bdbd47 could not be found. Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-07489f29-3abd-4983-84a9-b1132cf72b0a tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Returning 404 to user: Volume 794669fb-c6e7-4341-bb5a-092ef5bdbd47 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-07489f29-3abd-4983-84a9-b1132cf72b0a tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/794669fb-c6e7-4341-bb5a-092ef5bdbd47" status: 404 len: 109 microversion: 2.1 time: 0.041236 Jul 18 16:59:21.264305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 512/1034] 10.222.0.76 () {58 vars in 1247 bytes} [Mon Jul 18 16:59:21 2022] DELETE /compute/v2.1/os-volumes/794669fb-c6e7-4341-bb5a-092ef5bdbd47 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:59:21.270985 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2f04dba3-5a0b-448d-bdb6-c6545d60786e tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Calling method '.version_select at 0x7f4af16918b0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:21.299961 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-2f04dba3-5a0b-448d-bdb6-c6545d60786e tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] HTTP exception thrown: Volume 4ff9d006-7192-4b5e-b8c6-53752463c353 could not be found. Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2f04dba3-5a0b-448d-bdb6-c6545d60786e tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Request method failure captured: Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/os-volumes/4ff9d006-7192-4b5e-b8c6-53752463c353 HTTP/1.1 Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1ZFo8QKX2gW0cG5WMuO6c1zmrXi2_WQEr0GNUEIbou5LJcSok1sIvMA3KB-OfhwWlQWTFSLJzHczIjyOnSTnTj_7WBBr4e6E1lJZSRciplBszSZh_NRERYermdSVFxplnVx_JzLN8swYM2zD-d7HGGjC75UDdE7btyq1-v6Zfrb4P_s Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 5fd9fdac59f84165968e8fea0aa8cecf Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 16:59:21.301935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 16:59:21.305430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5fd9fdac59f84165968e8fea0aa8cecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 16:59:21.305430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.305430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 5fd9fdac59f84165968e8fea0aa8cecf Jul 18 16:59:21.305430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-VolumesNegativeTest-1435611437 Jul 18 16:59:21.305430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-VolumesNegativeTest-1435611437-project Jul 18 16:59:21.305430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 16:59:21.305430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 16:59:21.305430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 3788a5f76e9442268b73fc2cd17a5a15 Jul 18 16:59:21.305430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-VolumesNegativeTest-1435611437-project Jul 18 16:59:21.305430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: Jul 18 16:59:21.305430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Volume 4ff9d006-7192-4b5e-b8c6-53752463c353 could not be found. Jul 18 16:59:21.305430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '4ff9d006-7192-4b5e-b8c6-53752463c353'} Jul 18 16:59:21.305430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ff9d006-7192-4b5e-b8c6-53752463c353 could not be found. (HTTP 404) (Request-ID: req-ab3a3164-b7a5-4a63-936e-4b965fbfcfcd) Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.306937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:59:21.309650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ff9d006-7192-4b5e-b8c6-53752463c353 could not be found. Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:59:21.311672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ff9d006-7192-4b5e-b8c6-53752463c353 could not be found. Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ff9d006-7192-4b5e-b8c6-53752463c353 could not be found. Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2f04dba3-5a0b-448d-bdb6-c6545d60786e tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] Returning 404 to user: Volume 4ff9d006-7192-4b5e-b8c6-53752463c353 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2f04dba3-5a0b-448d-bdb6-c6545d60786e tempest-VolumesNegativeTest-1435611437 tempest-VolumesNegativeTest-1435611437-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/4ff9d006-7192-4b5e-b8c6-53752463c353" status: 404 len: 109 microversion: 2.1 time: 0.036332 Jul 18 16:59:21.313882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 523/1035] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 16:59:21 2022] GET /compute/v2.1/os-volumes/4ff9d006-7192-4b5e-b8c6-53752463c353 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:00:00.004530 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-35e8eedd-6710-4e04-97e8-4b66fd4167bc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:00.005538 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-35e8eedd-6710-4e04-97e8-4b66fd4167bc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:00.015001 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35e8eedd-6710-4e04-97e8-4b66fd4167bc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:00.015443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35e8eedd-6710-4e04-97e8-4b66fd4167bc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:00.016199 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35e8eedd-6710-4e04-97e8-4b66fd4167bc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:00.016643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35e8eedd-6710-4e04-97e8-4b66fd4167bc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:00.045202 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-35e8eedd-6710-4e04-97e8-4b66fd4167bc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045595 Jul 18 17:00:00.045724 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 513/1036] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 16:59:59 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 17:00:00.105319 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c1af4a5c-2db3-46bd-8f44-7dcc9e9439bd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:00.105917 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c1af4a5c-2db3-46bd-8f44-7dcc9e9439bd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:00.112274 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c1af4a5c-2db3-46bd-8f44-7dcc9e9439bd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:00.112715 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c1af4a5c-2db3-46bd-8f44-7dcc9e9439bd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:00.113504 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c1af4a5c-2db3-46bd-8f44-7dcc9e9439bd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:00.113958 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c1af4a5c-2db3-46bd-8f44-7dcc9e9439bd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:00.138731 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c1af4a5c-2db3-46bd-8f44-7dcc9e9439bd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:00:00.454390 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c1af4a5c-2db3-46bd-8f44-7dcc9e9439bd tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 204 len: 0 microversion: 2.1 time: 0.354776 Jul 18 17:00:00.454901 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 524/1037] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:00:00 2022] DELETE /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:00:00.463155 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-abd53ba7-3e85-4584-b329-6d5a25c41dd6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:00.463803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-abd53ba7-3e85-4584-b329-6d5a25c41dd6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:00.470549 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-abd53ba7-3e85-4584-b329-6d5a25c41dd6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:00.471007 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-abd53ba7-3e85-4584-b329-6d5a25c41dd6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:00.471776 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-abd53ba7-3e85-4584-b329-6d5a25c41dd6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:00.472220 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-abd53ba7-3e85-4584-b329-6d5a25c41dd6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:00.607176 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-abd53ba7-3e85-4584-b329-6d5a25c41dd6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:00.615020 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-abd53ba7-3e85-4584-b329-6d5a25c41dd6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1673 microversion: 2.1 time: 0.155802 Jul 18 17:00:00.615589 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 514/1038] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:00 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:00:01.634638 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a764dc7e-660a-4c8e-8192-731fb5a4860c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:01.635429 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a764dc7e-660a-4c8e-8192-731fb5a4860c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:01.642558 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a764dc7e-660a-4c8e-8192-731fb5a4860c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:01.643012 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a764dc7e-660a-4c8e-8192-731fb5a4860c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:01.643785 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a764dc7e-660a-4c8e-8192-731fb5a4860c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:01.644227 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a764dc7e-660a-4c8e-8192-731fb5a4860c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:01.780263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a764dc7e-660a-4c8e-8192-731fb5a4860c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:01.788393 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a764dc7e-660a-4c8e-8192-731fb5a4860c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1673 microversion: 2.1 time: 0.157932 Jul 18 17:00:01.789102 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 525/1039] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:01 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:02.806580 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-76d43c37-6044-4070-bf87-158b31074e15 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:02.807161 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-76d43c37-6044-4070-bf87-158b31074e15 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:02.813805 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-76d43c37-6044-4070-bf87-158b31074e15 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:02.814257 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-76d43c37-6044-4070-bf87-158b31074e15 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:02.815027 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-76d43c37-6044-4070-bf87-158b31074e15 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:02.815469 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-76d43c37-6044-4070-bf87-158b31074e15 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:02.954183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-76d43c37-6044-4070-bf87-158b31074e15 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:02.961840 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-76d43c37-6044-4070-bf87-158b31074e15 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1673 microversion: 2.1 time: 0.159246 Jul 18 17:00:02.962407 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 515/1040] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:02 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:03.980262 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d822d5c6-9138-4c91-acfc-1b144fad52e2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:03.980990 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d822d5c6-9138-4c91-acfc-1b144fad52e2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:03.988205 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d822d5c6-9138-4c91-acfc-1b144fad52e2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:03.988660 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d822d5c6-9138-4c91-acfc-1b144fad52e2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:03.989462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d822d5c6-9138-4c91-acfc-1b144fad52e2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:03.989895 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d822d5c6-9138-4c91-acfc-1b144fad52e2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:04.127796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d822d5c6-9138-4c91-acfc-1b144fad52e2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:04.135567 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d822d5c6-9138-4c91-acfc-1b144fad52e2 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1673 microversion: 2.1 time: 0.160454 Jul 18 17:00:04.136689 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 526/1041] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:03 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:04.530677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-16b54895-6896-4bb5-9391-6884b8b1d629 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1555971275"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:04.531263 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-16b54895-6896-4bb5-9391-6884b8b1d629 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:04.538302 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-16b54895-6896-4bb5-9391-6884b8b1d629 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:04.538910 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-16b54895-6896-4bb5-9391-6884b8b1d629 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:04.539723 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-16b54895-6896-4bb5-9391-6884b8b1d629 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:04.540246 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-16b54895-6896-4bb5-9391-6884b8b1d629 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:04.667978 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.network.security_group_api [None req-16b54895-6896-4bb5-9391-6884b8b1d629 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Removing security group 710a8612-eaa1-453d-92e4-b55922470eb9 from port ffbf241e-13b6-4507-9161-8a88eafc095a Jul 18 17:00:05.154323 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-889ecaf7-df1d-4187-ac88-b33d1f3a2c10 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:05.155047 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-889ecaf7-df1d-4187-ac88-b33d1f3a2c10 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:05.163562 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-889ecaf7-df1d-4187-ac88-b33d1f3a2c10 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:05.164095 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-889ecaf7-df1d-4187-ac88-b33d1f3a2c10 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:05.164883 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-889ecaf7-df1d-4187-ac88-b33d1f3a2c10 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:05.165348 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-889ecaf7-df1d-4187-ac88-b33d1f3a2c10 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:05.298502 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-889ecaf7-df1d-4187-ac88-b33d1f3a2c10 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:05.306094 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-889ecaf7-df1d-4187-ac88-b33d1f3a2c10 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1673 microversion: 2.1 time: 0.156032 Jul 18 17:00:05.306662 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 527/1042] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:05 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:00:05.371309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-16b54895-6896-4bb5-9391-6884b8b1d629 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "POST /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/action" status: 202 len: 0 microversion: 2.1 time: 0.843072 Jul 18 17:00:05.371309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 516/1043] 10.222.0.76 () {60 vars in 1277 bytes} [Mon Jul 18 17:00:04 2022] POST /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/action => generated 0 bytes in 844 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:00:05.380037 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-2c83a767-7b02-4892-8ffc-e135a9239a2d req-f7bc4cb1-81b6-4322-b9ad-909b487a8956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb84650-2a5a-491b-a7fd-2b80fc1b8c57", "tag": "ffbf241e-13b6-4507-9161-8a88eafc095a"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:05.388752 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-2c83a767-7b02-4892-8ffc-e135a9239a2d req-f7bc4cb1-81b6-4322-b9ad-909b487a8956 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:05.388874 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-2c83a767-7b02-4892-8ffc-e135a9239a2d req-f7bc4cb1-81b6-4322-b9ad-909b487a8956 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:05.400881 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-2c83a767-7b02-4892-8ffc-e135a9239a2d req-f7bc4cb1-81b6-4322-b9ad-909b487a8956 service nova] Creating event network-changed:ffbf241e-13b6-4507-9161-8a88eafc095a for instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 on hv-cinder-83754 Jul 18 17:00:05.406557 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-2c83a767-7b02-4892-8ffc-e135a9239a2d req-f7bc4cb1-81b6-4322-b9ad-909b487a8956 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030212 Jul 18 17:00:05.407483 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 528/1044] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:06.325687 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-113b0471-2eee-4e3b-84e9-b0408003e186 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:06.326479 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-113b0471-2eee-4e3b-84e9-b0408003e186 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:06.333227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-113b0471-2eee-4e3b-84e9-b0408003e186 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:06.334204 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-113b0471-2eee-4e3b-84e9-b0408003e186 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:06.335410 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-113b0471-2eee-4e3b-84e9-b0408003e186 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:06.336054 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-113b0471-2eee-4e3b-84e9-b0408003e186 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:06.643684 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-113b0471-2eee-4e3b-84e9-b0408003e186 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:06.652070 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-113b0471-2eee-4e3b-84e9-b0408003e186 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1673 microversion: 2.1 time: 0.331528 Jul 18 17:00:06.653170 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 517/1045] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:06 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1673 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:06.981713 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5b722f19-91ba-4987-899f-b9c74996d233 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:06.982437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5b722f19-91ba-4987-899f-b9c74996d233 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:06.992759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5b722f19-91ba-4987-899f-b9c74996d233 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:06.993624 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5b722f19-91ba-4987-899f-b9c74996d233 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:06.994668 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5b722f19-91ba-4987-899f-b9c74996d233 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:06.995885 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5b722f19-91ba-4987-899f-b9c74996d233 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:07.100837 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-5b722f19-91ba-4987-899f-b9c74996d233 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lazy-loading 'services' on Instance uuid 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:00:07.102585 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-0cc2c68f-8802-4cb7-896d-5b5863b927c4 req-e3759001-8e79-4f34-b0ba-1821d2bc44dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f8d5ca4-1bea-450f-8560-c07717d110e6", "name": "network-vif-deleted", "tag": "9684bdcd-2157-4629-9abd-16f5ea448f39"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:07.119365 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-0cc2c68f-8802-4cb7-896d-5b5863b927c4 req-e3759001-8e79-4f34-b0ba-1821d2bc44dd service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:07.120077 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-0cc2c68f-8802-4cb7-896d-5b5863b927c4 req-e3759001-8e79-4f34-b0ba-1821d2bc44dd service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:07.141103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-0cc2c68f-8802-4cb7-896d-5b5863b927c4 req-e3759001-8e79-4f34-b0ba-1821d2bc44dd service nova] Creating event network-vif-deleted:9684bdcd-2157-4629-9abd-16f5ea448f39 for instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 on hv-cinder-83754 Jul 18 17:00:07.150415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-0cc2c68f-8802-4cb7-896d-5b5863b927c4 req-e3759001-8e79-4f34-b0ba-1821d2bc44dd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048849 Jul 18 17:00:07.152448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 518/1046] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:00:07.408279 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5b722f19-91ba-4987-899f-b9c74996d233 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/os-volume_attachments/7cf3ebc1-8884-4986-be04-6cf49612b7c3" status: 202 len: 0 microversion: 2.1 time: 0.431967 Jul 18 17:00:07.414856 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 529/1047] 10.222.0.76 () {58 vars in 1415 bytes} [Mon Jul 18 17:00:06 2022] DELETE /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/os-volume_attachments/7cf3ebc1-8884-4986-be04-6cf49612b7c3 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:00:07.419429 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-12928ebb-dbce-4ec9-b595-7d74d2857c4c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:07.421425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-12928ebb-dbce-4ec9-b595-7d74d2857c4c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:07.429636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-ce3ad6bf-7662-4253-9b27-da545496b98c req-4529930f-2deb-47fb-b516-b9bbc4c0a3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb84650-2a5a-491b-a7fd-2b80fc1b8c57", "tag": "ffbf241e-13b6-4507-9161-8a88eafc095a"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:07.430647 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12928ebb-dbce-4ec9-b595-7d74d2857c4c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:07.455492 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12928ebb-dbce-4ec9-b595-7d74d2857c4c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:07.457868 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12928ebb-dbce-4ec9-b595-7d74d2857c4c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:07.459535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12928ebb-dbce-4ec9-b595-7d74d2857c4c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:07.491375 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-ce3ad6bf-7662-4253-9b27-da545496b98c req-4529930f-2deb-47fb-b516-b9bbc4c0a3e0 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:07.492836 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-ce3ad6bf-7662-4253-9b27-da545496b98c req-4529930f-2deb-47fb-b516-b9bbc4c0a3e0 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:07.508645 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-12928ebb-dbce-4ec9-b595-7d74d2857c4c tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094886 Jul 18 17:00:07.509843 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 519/1048] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:00:07 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:07.528309 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-ce3ad6bf-7662-4253-9b27-da545496b98c req-4529930f-2deb-47fb-b516-b9bbc4c0a3e0 service nova] Creating event network-changed:ffbf241e-13b6-4507-9161-8a88eafc095a for instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 on hv-cinder-83754 Jul 18 17:00:07.543246 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-ce3ad6bf-7662-4253-9b27-da545496b98c req-4529930f-2deb-47fb-b516-b9bbc4c0a3e0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115501 Jul 18 17:00:07.545161 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 530/1049] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:07.670113 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5a40babb-a7a9-4520-aff9-c7dcff076473 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:07.671143 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5a40babb-a7a9-4520-aff9-c7dcff076473 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:07.677673 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5a40babb-a7a9-4520-aff9-c7dcff076473 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:07.678252 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5a40babb-a7a9-4520-aff9-c7dcff076473 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:07.679765 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5a40babb-a7a9-4520-aff9-c7dcff076473 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:07.680444 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5a40babb-a7a9-4520-aff9-c7dcff076473 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:07.719751 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5a40babb-a7a9-4520-aff9-c7dcff076473 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:07.720292 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5a40babb-a7a9-4520-aff9-c7dcff076473 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:07.720815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-5a40babb-a7a9-4520-aff9-c7dcff076473 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lazy-loading 'fault' on Instance uuid 2f8d5ca4-1bea-450f-8560-c07717d110e6 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:00:07.790912 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5a40babb-a7a9-4520-aff9-c7dcff076473 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:07.803301 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5a40babb-a7a9-4520-aff9-c7dcff076473 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1327 microversion: 2.1 time: 0.137817 Jul 18 17:00:07.804008 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 520/1050] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:07 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1327 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:08.525495 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-365a251c-737a-45b9-ba10-d9e3d5f17b35 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:08.527233 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-365a251c-737a-45b9-ba10-d9e3d5f17b35 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:08.534328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-365a251c-737a-45b9-ba10-d9e3d5f17b35 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:08.534776 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-365a251c-737a-45b9-ba10-d9e3d5f17b35 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:08.535544 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-365a251c-737a-45b9-ba10-d9e3d5f17b35 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:08.535973 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-365a251c-737a-45b9-ba10-d9e3d5f17b35 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:08.565987 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-365a251c-737a-45b9-ba10-d9e3d5f17b35 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047069 Jul 18 17:00:08.566546 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 531/1051] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:00:08 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:08.827267 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-87a27b43-a68e-47ad-b138-4b3065b95d95 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:08.827884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-87a27b43-a68e-47ad-b138-4b3065b95d95 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:08.838203 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87a27b43-a68e-47ad-b138-4b3065b95d95 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:08.838970 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87a27b43-a68e-47ad-b138-4b3065b95d95 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:08.840763 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87a27b43-a68e-47ad-b138-4b3065b95d95 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:08.841447 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87a27b43-a68e-47ad-b138-4b3065b95d95 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:08.883798 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87a27b43-a68e-47ad-b138-4b3065b95d95 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:08.884165 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87a27b43-a68e-47ad-b138-4b3065b95d95 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:08.884620 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-87a27b43-a68e-47ad-b138-4b3065b95d95 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lazy-loading 'fault' on Instance uuid 2f8d5ca4-1bea-450f-8560-c07717d110e6 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:00:08.931922 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-87a27b43-a68e-47ad-b138-4b3065b95d95 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:08.943126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-87a27b43-a68e-47ad-b138-4b3065b95d95 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 200 len: 1327 microversion: 2.1 time: 0.120911 Jul 18 17:00:08.953521 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 521/1052] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:08 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 1327 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:09.579162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aeb24155-86c9-4699-b25b-1696226fb012 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:09.580000 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aeb24155-86c9-4699-b25b-1696226fb012 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:09.586527 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aeb24155-86c9-4699-b25b-1696226fb012 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:09.586982 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aeb24155-86c9-4699-b25b-1696226fb012 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:09.587762 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aeb24155-86c9-4699-b25b-1696226fb012 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:09.588203 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aeb24155-86c9-4699-b25b-1696226fb012 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:09.618327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aeb24155-86c9-4699-b25b-1696226fb012 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043159 Jul 18 17:00:09.619163 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 532/1053] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:00:09 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 17:00:09.629440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2f9087ce-82a0-4190-815c-2215984e8d96 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:09.629945 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2f9087ce-82a0-4190-815c-2215984e8d96 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:09.637218 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2f9087ce-82a0-4190-815c-2215984e8d96 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:09.641529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2f9087ce-82a0-4190-815c-2215984e8d96 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:09.641529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2f9087ce-82a0-4190-815c-2215984e8d96 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:09.641529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2f9087ce-82a0-4190-815c-2215984e8d96 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:09.724351 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-2f9087ce-82a0-4190-815c-2215984e8d96 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] HTTP exception thrown: Instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 is not attached to volume 7cf3ebc1-8884-4986-be04-6cf49612b7c3 Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2f9087ce-82a0-4190-815c-2215984e8d96 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Request method failure captured: Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/os-volume_attachments/7cf3ebc1-8884-4986-be04-6cf49612b7c3 HTTP/1.1 Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1ZBqB0D-hhHJl9WbXHBp_9fF7NjH37rM60NmIiPJaJb6tYk57uVUAuYrZtHx1H-AlJ98WTOUKuQsFfdbeKr4Rr4PwwJb_8R5nG5MRUxKUEQrBk93CnDpODzm9ENm_9CcXM95idpyo6ZTY46XqxYiQtYiLQe1LNfBYcETSxEJgy9OXDo Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: fbde8a43b24043e1bbab860fcbe67c91 Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-TestMinimumBasicScenario-1714425212 Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:00:09.726756 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:00:09.728404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbde8a43b24043e1bbab860fcbe67c91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbde8a43b24043e1bbab860fcbe67c91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbde8a43b24043e1bbab860fcbe67c91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbde8a43b24043e1bbab860fcbe67c91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:00:09.728404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-TestMinimumBasicScenario-1714425212 Jul 18 17:00:09.728404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: fbde8a43b24043e1bbab860fcbe67c91 Jul 18 17:00:09.728404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1714425212 Jul 18 17:00:09.728404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-TestMinimumBasicScenario-1714425212-project Jul 18 17:00:09.728404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:00:09.728404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:00:09.728404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 71a82de7d125480a9f23c8cdf0c05638 Jul 18 17:00:09.728404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-TestMinimumBasicScenario-1714425212-project Jul 18 17:00:09.728404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:00:09.728404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 is not attached to volume 7cf3ebc1-8884-4986-be04-6cf49612b7c3 Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'server_id': '1fb84650-2a5a-491b-a7fd-2b80fc1b8c57', 'id': '7cf3ebc1-8884-4986-be04-6cf49612b7c3'} Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7cf3ebc1-8884-4986-be04-6cf49612b7c3. Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:00:09.729265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 is not attached to volume 7cf3ebc1-8884-4986-be04-6cf49612b7c3 Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 is not attached to volume 7cf3ebc1-8884-4986-be04-6cf49612b7c3 Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:00:09.730943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2f9087ce-82a0-4190-815c-2215984e8d96 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Returning 404 to user: Instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 is not attached to volume 7cf3ebc1-8884-4986-be04-6cf49612b7c3 {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:00:09.732103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2f9087ce-82a0-4190-815c-2215984e8d96 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/os-volume_attachments/7cf3ebc1-8884-4986-be04-6cf49612b7c3" status: 404 len: 154 microversion: 2.1 time: 0.102992 Jul 18 17:00:09.732103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 522/1054] 10.222.0.76 () {58 vars in 1415 bytes} [Mon Jul 18 17:00:09 2022] DELETE /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57/os-volume_attachments/7cf3ebc1-8884-4986-be04-6cf49612b7c3 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:00:09.961496 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-103f2d04-0b6e-489e-adb1-e9e79c81f38a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:09.962035 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-103f2d04-0b6e-489e-adb1-e9e79c81f38a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:09.968080 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-103f2d04-0b6e-489e-adb1-e9e79c81f38a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:09.968536 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-103f2d04-0b6e-489e-adb1-e9e79c81f38a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:09.969337 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-103f2d04-0b6e-489e-adb1-e9e79c81f38a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:09.969780 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-103f2d04-0b6e-489e-adb1-e9e79c81f38a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:09.983741 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-103f2d04-0b6e-489e-adb1-e9e79c81f38a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] HTTP exception thrown: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-103f2d04-0b6e-489e-adb1-e9e79c81f38a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Request method failure captured: Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 HTTP/1.1 Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y_rIc84oOOembKBLVr2GgL_nE5Fr1mHgNYcVf10vYnB7uFrNv9bctz44zvS2aZow9NPqnSx0qBm-BQp9z9G4LFWCCdOOupTTM1R1v5cfK-RRp2_3Ats8hPUHLWpW0aYaB34ircLMkjRX654ZLEInfTawo0DRnhy4xNU46zJ7AIxDYQ Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: d713a57b50cf4fe3b0fc1bd63cb761fd Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 17:00:09.985477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 17:00:09.987286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:00:09.987286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:00:09.987286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: d713a57b50cf4fe3b0fc1bd63cb761fd Jul 18 17:00:09.987286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:00:09.987286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeTestJSON-608912424-project Jul 18 17:00:09.987286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 17:00:09.987286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 17:00:09.987286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 7b98162f0ce8462fa1a20871ab1a6560 Jul 18 17:00:09.987286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeTestJSON-608912424-project Jul 18 17:00:09.987286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 17:00:09.987286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:00:09.987286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '2f8d5ca4-1bea-450f-8560-c07717d110e6'} Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:00:09.988247 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:00:09.989851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:00:09.991527 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-103f2d04-0b6e-489e-adb1-e9e79c81f38a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Returning 404 to user: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:00:09.991527 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-103f2d04-0b6e-489e-adb1-e9e79c81f38a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 404 len: 111 microversion: 2.1 time: 0.029794 Jul 18 17:00:09.991527 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 533/1055] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:09 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:00:09.996789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0fec836c-1f85-4825-aaf3-36142360c7a8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '.version_select at 0x7f4af14ab310>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:10.107139 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0fec836c-1f85-4825-aaf3-36142360c7a8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449833633" status: 202 len: 0 microversion: 2.1 time: 0.114783 Jul 18 17:00:10.107713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 523/1056] 10.222.0.76 () {58 vars in 1220 bytes} [Mon Jul 18 17:00:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449833633 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:00:10.965815 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6a44c566-f0b4-4b64-a3ed-3fc2c4d02acb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Action: 'create', calling method: .version_select at 0x7f4af1645b80>, body: {"keypair": {"name": "tempest-keypair-785173414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEemgeG5oH1F/XL/upoZcvlpqPcHxZ/PXWg8pKQ+SW31yjX0yslmOLHT5+CPHY2pysK06DV2oYS5FofKx7ZL6BasA0zvHKZGmdZMkGEHfcrQ1Fr0CIeH3Y/NsRAZfUYkQ=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:10.981187 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-6a44c566-f0b4-4b64-a3ed-3fc2c4d02acb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Getting quotas for project d713a57b50cf4fe3b0fc1bd63cb761fd. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:00:10.985397 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-6a44c566-f0b4-4b64-a3ed-3fc2c4d02acb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Getting quotas for user 7b98162f0ce8462fa1a20871ab1a6560 and project d713a57b50cf4fe3b0fc1bd63cb761fd. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:00:11.120874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d89edaf5-954d-4381-a958-2cd56f991c73 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:11.121423 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d89edaf5-954d-4381-a958-2cd56f991c73 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:11.129038 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d89edaf5-954d-4381-a958-2cd56f991c73 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:11.129430 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6a44c566-f0b4-4b64-a3ed-3fc2c4d02acb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.167933 Jul 18 17:00:11.129704 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d89edaf5-954d-4381-a958-2cd56f991c73 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:11.130028 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 534/1057] 10.222.0.76 () {60 vars in 1158 bytes} [Mon Jul 18 17:00:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:00:11.130569 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d89edaf5-954d-4381-a958-2cd56f991c73 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:11.131038 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d89edaf5-954d-4381-a958-2cd56f991c73 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:11.157589 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d89edaf5-954d-4381-a958-2cd56f991c73 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:00:11.506113 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d89edaf5-954d-4381-a958-2cd56f991c73 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 204 len: 0 microversion: 2.1 time: 0.388781 Jul 18 17:00:11.506709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 524/1058] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:00:11 2022] DELETE /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:00:11.515057 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-61c78bb0-0241-4e2e-9644-c69a77e03a21 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:11.521652 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-61c78bb0-0241-4e2e-9644-c69a77e03a21 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:11.523811 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-61c78bb0-0241-4e2e-9644-c69a77e03a21 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:11.524270 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-61c78bb0-0241-4e2e-9644-c69a77e03a21 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:11.525064 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-61c78bb0-0241-4e2e-9644-c69a77e03a21 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:11.525510 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-61c78bb0-0241-4e2e-9644-c69a77e03a21 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:11.683263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-61c78bb0-0241-4e2e-9644-c69a77e03a21 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:11.694603 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-61c78bb0-0241-4e2e-9644-c69a77e03a21 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1554 microversion: 2.1 time: 0.183408 Jul 18 17:00:11.695090 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 535/1059] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:11 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:00:12.712468 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-adcb0ce6-e682-43bb-9d42-9f777911da93 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:12.713202 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-adcb0ce6-e682-43bb-9d42-9f777911da93 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:12.720426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-adcb0ce6-e682-43bb-9d42-9f777911da93 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:12.720883 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-adcb0ce6-e682-43bb-9d42-9f777911da93 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:12.721707 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-adcb0ce6-e682-43bb-9d42-9f777911da93 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:12.722152 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-adcb0ce6-e682-43bb-9d42-9f777911da93 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:12.934738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-adcb0ce6-e682-43bb-9d42-9f777911da93 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:12.942564 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-adcb0ce6-e682-43bb-9d42-9f777911da93 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1554 microversion: 2.1 time: 0.234410 Jul 18 17:00:12.943153 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 525/1060] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:12 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1554 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:13.898609 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1541102212", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac86b6c7-541a-476d-96e8-030cd9ab03ec"}], "security_groups": [{"name": "tempest-securitygroup--890398672"}], "key_name": "tempest-keypair-785173414", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:13.959711 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0223c9b8-3399-45ad-9ff8-a10b8bbe7fec tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:13.960940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0223c9b8-3399-45ad-9ff8-a10b8bbe7fec tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:13.968589 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0223c9b8-3399-45ad-9ff8-a10b8bbe7fec tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:13.969056 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0223c9b8-3399-45ad-9ff8-a10b8bbe7fec tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:13.970015 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0223c9b8-3399-45ad-9ff8-a10b8bbe7fec tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:13.970642 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0223c9b8-3399-45ad-9ff8-a10b8bbe7fec tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:14.016579 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] validate_networks() for [('ac86b6c7-541a-476d-96e8-030cd9ab03ec', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:00:14.453498 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:00:14.454409 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:00:14.455143 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:00:14.455953 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:00:14.456790 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:00:14.469579 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:14.473412 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:14.473412 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:14.473412 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:14.489759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Getting quotas for project d713a57b50cf4fe3b0fc1bd63cb761fd. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:00:14.493863 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Getting quotas for user 7b98162f0ce8462fa1a20871ab1a6560 and project d713a57b50cf4fe3b0fc1bd63cb761fd. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:00:14.503516 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0223c9b8-3399-45ad-9ff8-a10b8bbe7fec tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:14.508262 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:00:14.511253 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:00:14.513569 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0223c9b8-3399-45ad-9ff8-a10b8bbe7fec tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1554 microversion: 2.1 time: 0.556227 Jul 18 17:00:14.521787 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 526/1061] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:13 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1554 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:00:14.658749 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-59a5f4d6-6bf8-4f57-8464-4ebf30b8b287 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.764334 Jul 18 17:00:14.659623 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 536/1062] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 17:00:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 17:00:14.670344 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-398989b6-326e-48ed-a2fa-954dc6afdd83 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:14.671205 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-398989b6-326e-48ed-a2fa-954dc6afdd83 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:14.734072 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-398989b6-326e-48ed-a2fa-954dc6afdd83 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:14.741095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-398989b6-326e-48ed-a2fa-954dc6afdd83 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1237 microversion: 2.1 time: 0.075124 Jul 18 17:00:14.741672 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 527/1063] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:14 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:00:14.862781 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-3295d1ca-98f6-4335-bdaf-e9dcea6da66a req-3ac81858-bbb5-4a2e-8ccd-dc1176c392b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb84650-2a5a-491b-a7fd-2b80fc1b8c57", "name": "network-vif-deleted", "tag": "ffbf241e-13b6-4507-9161-8a88eafc095a"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:14.872973 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-3295d1ca-98f6-4335-bdaf-e9dcea6da66a req-3ac81858-bbb5-4a2e-8ccd-dc1176c392b1 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:14.873468 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-3295d1ca-98f6-4335-bdaf-e9dcea6da66a req-3ac81858-bbb5-4a2e-8ccd-dc1176c392b1 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:14.883989 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-3295d1ca-98f6-4335-bdaf-e9dcea6da66a req-3ac81858-bbb5-4a2e-8ccd-dc1176c392b1 service nova] Creating event network-vif-deleted:ffbf241e-13b6-4507-9161-8a88eafc095a for instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 on hv-cinder-83754 Jul 18 17:00:14.889658 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-3295d1ca-98f6-4335-bdaf-e9dcea6da66a req-3ac81858-bbb5-4a2e-8ccd-dc1176c392b1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031101 Jul 18 17:00:14.890248 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 537/1064] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:15.698914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1cd786ab-72b1-442e-941e-a7e0d8d7125b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:15.699407 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1cd786ab-72b1-442e-941e-a7e0d8d7125b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:15.705969 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cd786ab-72b1-442e-941e-a7e0d8d7125b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:15.706425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cd786ab-72b1-442e-941e-a7e0d8d7125b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:15.707186 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cd786ab-72b1-442e-941e-a7e0d8d7125b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:15.707624 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cd786ab-72b1-442e-941e-a7e0d8d7125b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:15.741483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cd786ab-72b1-442e-941e-a7e0d8d7125b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:15.741936 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cd786ab-72b1-442e-941e-a7e0d8d7125b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:15.742388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-1cd786ab-72b1-442e-941e-a7e0d8d7125b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lazy-loading 'fault' on Instance uuid 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:00:15.759840 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-753310de-b45f-4ac3-8d05-61024dbb466f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:15.761066 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-753310de-b45f-4ac3-8d05-61024dbb466f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:15.767414 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-753310de-b45f-4ac3-8d05-61024dbb466f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:15.768111 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-753310de-b45f-4ac3-8d05-61024dbb466f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:15.768902 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-753310de-b45f-4ac3-8d05-61024dbb466f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:15.769364 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-753310de-b45f-4ac3-8d05-61024dbb466f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:15.784145 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1cd786ab-72b1-442e-941e-a7e0d8d7125b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a82de7d125480a9f23c8cdf0c05638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbde8a43b24043e1bbab860fcbe67c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:15.793068 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1cd786ab-72b1-442e-941e-a7e0d8d7125b tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 200 len: 1348 microversion: 2.1 time: 0.268180 Jul 18 17:00:15.793861 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 528/1065] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:15 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 1348 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:00:15.839549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-753310de-b45f-4ac3-8d05-61024dbb466f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:15.845428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-753310de-b45f-4ac3-8d05-61024dbb466f tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1241 microversion: 2.1 time: 0.090848 Jul 18 17:00:15.846019 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 538/1066] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:15 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:00:16.811339 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-96a5bcf1-170f-4ce6-acda-b51bac18c4a6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:16.811957 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-96a5bcf1-170f-4ce6-acda-b51bac18c4a6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] [instance: 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:16.818788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96a5bcf1-170f-4ce6-acda-b51bac18c4a6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:16.819249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96a5bcf1-170f-4ce6-acda-b51bac18c4a6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:16.820032 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96a5bcf1-170f-4ce6-acda-b51bac18c4a6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:16.820481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96a5bcf1-170f-4ce6-acda-b51bac18c4a6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:16.834442 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-96a5bcf1-170f-4ce6-acda-b51bac18c4a6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] HTTP exception thrown: Instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 could not be found. Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-96a5bcf1-170f-4ce6-acda-b51bac18c4a6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Request method failure captured: Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 HTTP/1.1 Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1ZBqB0D-hhHJl9WbXHBp_9fF7NjH37rM60NmIiPJaJb6tYk57uVUAuYrZtHx1H-AlJ98WTOUKuQsFfdbeKr4Rr4PwwJb_8R5nG5MRUxKUEQrBk93CnDpODzm9ENm_9CcXM95idpyo6ZTY46XqxYiQtYiLQe1LNfBYcETSxEJgy9OXDo Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: fbde8a43b24043e1bbab860fcbe67c91 Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-TestMinimumBasicScenario-1714425212 Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:00:16.836119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:00:16.837713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbde8a43b24043e1bbab860fcbe67c91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbde8a43b24043e1bbab860fcbe67c91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbde8a43b24043e1bbab860fcbe67c91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbde8a43b24043e1bbab860fcbe67c91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:00:16.837713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-TestMinimumBasicScenario-1714425212 Jul 18 17:00:16.837713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: fbde8a43b24043e1bbab860fcbe67c91 Jul 18 17:00:16.837713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1714425212 Jul 18 17:00:16.837713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-TestMinimumBasicScenario-1714425212-project Jul 18 17:00:16.837713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:00:16.837713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:00:16.837713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 71a82de7d125480a9f23c8cdf0c05638 Jul 18 17:00:16.837713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-TestMinimumBasicScenario-1714425212-project Jul 18 17:00:16.837713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:00:16.837713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 could not be found. Jul 18 17:00:16.837713 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '1fb84650-2a5a-491b-a7fd-2b80fc1b8c57'} Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 could not be found. Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:00:16.838628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 could not be found. Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 could not be found. Jul 18 17:00:16.840738 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:00:16.842087 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-96a5bcf1-170f-4ce6-acda-b51bac18c4a6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Returning 404 to user: Instance 1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:00:16.842087 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-96a5bcf1-170f-4ce6-acda-b51bac18c4a6 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57" status: 404 len: 111 microversion: 2.1 time: 0.030460 Jul 18 17:00:16.842087 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 529/1067] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:16 2022] GET /compute/v2.1/servers/1fb84650-2a5a-491b-a7fd-2b80fc1b8c57 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:00:16.847467 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ec33cc8e-80de-42ca-8394-607cfe314a25 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] Calling method '.version_select at 0x7f4af1727e50>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:16.863014 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cbe31b06-139d-4ece-a16f-e86cf2ace5b4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:16.863634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cbe31b06-139d-4ece-a16f-e86cf2ace5b4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:16.869676 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cbe31b06-139d-4ece-a16f-e86cf2ace5b4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:16.870155 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cbe31b06-139d-4ece-a16f-e86cf2ace5b4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:16.870932 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cbe31b06-139d-4ece-a16f-e86cf2ace5b4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:16.871400 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cbe31b06-139d-4ece-a16f-e86cf2ace5b4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:16.894558 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:16.940519 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cbe31b06-139d-4ece-a16f-e86cf2ace5b4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:16.948013 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cbe31b06-139d-4ece-a16f-e86cf2ace5b4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1289 microversion: 2.1 time: 0.089159 Jul 18 17:00:16.948576 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 530/1068] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:16 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:00:16.987311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ec33cc8e-80de-42ca-8394-607cfe314a25 tempest-TestMinimumBasicScenario-1714425212 tempest-TestMinimumBasicScenario-1714425212-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1119680420" status: 202 len: 0 microversion: 2.1 time: 0.144021 Jul 18 17:00:16.987893 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 539/1069] 10.222.0.76 () {58 vars in 1271 bytes} [Mon Jul 18 17:00:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1119680420 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:00:17.975619 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bc4e3b98-dbd5-4b94-a6cc-aebeeee8eef4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:17.976233 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bc4e3b98-dbd5-4b94-a6cc-aebeeee8eef4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:17.984373 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bc4e3b98-dbd5-4b94-a6cc-aebeeee8eef4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:17.984825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bc4e3b98-dbd5-4b94-a6cc-aebeeee8eef4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:17.985708 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bc4e3b98-dbd5-4b94-a6cc-aebeeee8eef4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:17.986410 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bc4e3b98-dbd5-4b94-a6cc-aebeeee8eef4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:18.048097 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bc4e3b98-dbd5-4b94-a6cc-aebeeee8eef4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:18.055606 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bc4e3b98-dbd5-4b94-a6cc-aebeeee8eef4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1295 microversion: 2.1 time: 0.083800 Jul 18 17:00:18.056169 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 531/1070] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:17 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:19.073880 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-471a4077-4f99-4a0a-8d58-51d03ad7b99e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:19.074559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-471a4077-4f99-4a0a-8d58-51d03ad7b99e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:19.082973 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-471a4077-4f99-4a0a-8d58-51d03ad7b99e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:19.083428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-471a4077-4f99-4a0a-8d58-51d03ad7b99e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:19.084243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-471a4077-4f99-4a0a-8d58-51d03ad7b99e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:19.084686 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-471a4077-4f99-4a0a-8d58-51d03ad7b99e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:19.329461 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-471a4077-4f99-4a0a-8d58-51d03ad7b99e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:19.337798 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-471a4077-4f99-4a0a-8d58-51d03ad7b99e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1362 microversion: 2.1 time: 0.268418 Jul 18 17:00:19.338528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 540/1071] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:19 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:20.357764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9bfc2a29-5bdd-4f66-a7d8-55d6f2dc2f21 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:20.358569 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9bfc2a29-5bdd-4f66-a7d8-55d6f2dc2f21 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:20.367336 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9bfc2a29-5bdd-4f66-a7d8-55d6f2dc2f21 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:20.367814 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9bfc2a29-5bdd-4f66-a7d8-55d6f2dc2f21 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:20.368740 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9bfc2a29-5bdd-4f66-a7d8-55d6f2dc2f21 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:20.369223 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9bfc2a29-5bdd-4f66-a7d8-55d6f2dc2f21 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:20.510887 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9bfc2a29-5bdd-4f66-a7d8-55d6f2dc2f21 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:20.519237 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9bfc2a29-5bdd-4f66-a7d8-55d6f2dc2f21 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1362 microversion: 2.1 time: 0.166572 Jul 18 17:00:20.520083 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 532/1072] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:20 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:21.536113 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-952a7377-1909-46da-9993-1b12af274885 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:21.536778 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-952a7377-1909-46da-9993-1b12af274885 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:21.544197 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-952a7377-1909-46da-9993-1b12af274885 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:21.544807 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-952a7377-1909-46da-9993-1b12af274885 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:21.545992 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-952a7377-1909-46da-9993-1b12af274885 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:21.546720 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-952a7377-1909-46da-9993-1b12af274885 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:21.732853 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-952a7377-1909-46da-9993-1b12af274885 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:21.741178 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-952a7377-1909-46da-9993-1b12af274885 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1362 microversion: 2.1 time: 0.209123 Jul 18 17:00:21.741684 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 541/1073] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:21 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:22.500939 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-e8edd4fa-cf16-4b28-9906-a1e7a96cb666 req-f148b4bb-a13e-4c26-a28c-80b700ce2ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "713eeca4-97c2-49c7-a6e6-a438f9b5c9d4", "tag": "e8b1fd5e-f836-49aa-8495-9b0aee05d3f4"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:22.522151 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e8edd4fa-cf16-4b28-9906-a1e7a96cb666 req-f148b4bb-a13e-4c26-a28c-80b700ce2ffe service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:22.523148 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e8edd4fa-cf16-4b28-9906-a1e7a96cb666 req-f148b4bb-a13e-4c26-a28c-80b700ce2ffe service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:22.574573 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-e8edd4fa-cf16-4b28-9906-a1e7a96cb666 req-f148b4bb-a13e-4c26-a28c-80b700ce2ffe service nova] Creating event network-changed:e8b1fd5e-f836-49aa-8495-9b0aee05d3f4 for instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 on hv-cinder-83754 Jul 18 17:00:22.582233 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-e8edd4fa-cf16-4b28-9906-a1e7a96cb666 req-f148b4bb-a13e-4c26-a28c-80b700ce2ffe service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087422 Jul 18 17:00:22.584613 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 533/1074] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:22.763418 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-80e5c8a7-791d-40a6-be6d-5ab9307a5862 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:22.764216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-80e5c8a7-791d-40a6-be6d-5ab9307a5862 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:22.788471 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-80e5c8a7-791d-40a6-be6d-5ab9307a5862 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:22.789179 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-80e5c8a7-791d-40a6-be6d-5ab9307a5862 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:22.790126 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-80e5c8a7-791d-40a6-be6d-5ab9307a5862 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:22.790671 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-80e5c8a7-791d-40a6-be6d-5ab9307a5862 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:23.072875 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-80e5c8a7-791d-40a6-be6d-5ab9307a5862 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:23.088191 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-80e5c8a7-791d-40a6-be6d-5ab9307a5862 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1362 microversion: 2.1 time: 0.333251 Jul 18 17:00:23.089059 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 542/1075] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:22 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:24.119897 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-37ca13b4-3afb-4114-abbd-ace62b0f93c6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:24.120569 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-37ca13b4-3afb-4114-abbd-ace62b0f93c6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:24.138997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-37ca13b4-3afb-4114-abbd-ace62b0f93c6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:24.138997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-37ca13b4-3afb-4114-abbd-ace62b0f93c6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:24.138997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-37ca13b4-3afb-4114-abbd-ace62b0f93c6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:24.138997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-37ca13b4-3afb-4114-abbd-ace62b0f93c6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:24.293518 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-37ca13b4-3afb-4114-abbd-ace62b0f93c6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:24.305530 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-37ca13b4-3afb-4114-abbd-ace62b0f93c6 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1362 microversion: 2.1 time: 0.190339 Jul 18 17:00:24.306125 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 534/1076] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:24 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:25.323824 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9da3cd18-915a-49c3-a292-938fde793524 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:25.325593 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9da3cd18-915a-49c3-a292-938fde793524 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:25.328227 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:25.329142 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=10 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:25.334642 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9da3cd18-915a-49c3-a292-938fde793524 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:25.335460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9da3cd18-915a-49c3-a292-938fde793524 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:25.336240 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9da3cd18-915a-49c3-a292-938fde793524 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:25.336679 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9da3cd18-915a-49c3-a292-938fde793524 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:25.357720 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:25.535307 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9da3cd18-915a-49c3-a292-938fde793524 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:25.543751 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9da3cd18-915a-49c3-a292-938fde793524 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1362 microversion: 2.1 time: 0.223312 Jul 18 17:00:25.544673 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 543/1077] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:25 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:26.559070 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:26.576697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c1d3dedf-27c1-4de1-88b4-1fcd7665bb23 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:26.576697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c1d3dedf-27c1-4de1-88b4-1fcd7665bb23 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:26.578825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c1d3dedf-27c1-4de1-88b4-1fcd7665bb23 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:26.579283 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c1d3dedf-27c1-4de1-88b4-1fcd7665bb23 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:26.580061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c1d3dedf-27c1-4de1-88b4-1fcd7665bb23 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:26.580503 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c1d3dedf-27c1-4de1-88b4-1fcd7665bb23 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:26.762461 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c1d3dedf-27c1-4de1-88b4-1fcd7665bb23 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:26.772309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c1d3dedf-27c1-4de1-88b4-1fcd7665bb23 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1362 microversion: 2.1 time: 0.215019 Jul 18 17:00:26.776221 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 535/1078] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:26 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:27.790204 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6d350fda-d1d5-40d5-bf3f-43c39b961b89 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:27.790681 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6d350fda-d1d5-40d5-bf3f-43c39b961b89 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:27.798614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6d350fda-d1d5-40d5-bf3f-43c39b961b89 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:27.800378 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6d350fda-d1d5-40d5-bf3f-43c39b961b89 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:27.800378 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6d350fda-d1d5-40d5-bf3f-43c39b961b89 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:27.800378 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6d350fda-d1d5-40d5-bf3f-43c39b961b89 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:28.006099 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6d350fda-d1d5-40d5-bf3f-43c39b961b89 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:28.014597 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6d350fda-d1d5-40d5-bf3f-43c39b961b89 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1362 microversion: 2.1 time: 0.228231 Jul 18 17:00:28.027284 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 544/1079] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:27 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:29.037068 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6416c42d-13e9-4e17-8be0-aa8dfa59a3c9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:29.037731 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6416c42d-13e9-4e17-8be0-aa8dfa59a3c9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:29.045419 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6416c42d-13e9-4e17-8be0-aa8dfa59a3c9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:29.045916 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6416c42d-13e9-4e17-8be0-aa8dfa59a3c9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:29.046688 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6416c42d-13e9-4e17-8be0-aa8dfa59a3c9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:29.047130 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6416c42d-13e9-4e17-8be0-aa8dfa59a3c9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:29.219025 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6416c42d-13e9-4e17-8be0-aa8dfa59a3c9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:29.227030 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6416c42d-13e9-4e17-8be0-aa8dfa59a3c9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1362 microversion: 2.1 time: 0.193848 Jul 18 17:00:29.228045 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 536/1080] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:29 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:00:30.255606 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d4590119-69c5-416e-8b21-b5932afc895a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:30.256381 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d4590119-69c5-416e-8b21-b5932afc895a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:30.263738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:30.267452 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d4590119-69c5-416e-8b21-b5932afc895a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.273773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d4590119-69c5-416e-8b21-b5932afc895a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.273773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d4590119-69c5-416e-8b21-b5932afc895a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.273773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d4590119-69c5-416e-8b21-b5932afc895a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.407957 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-bff298be-6a1b-4c88-a22f-32f630df57b0 req-ee41f53b-50dc-4004-bf10-1f0bb73be26e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "713eeca4-97c2-49c7-a6e6-a438f9b5c9d4", "name": "network-vif-plugged", "status": "completed", "tag": "e8b1fd5e-f836-49aa-8495-9b0aee05d3f4"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:30.418683 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:30.426548 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-bff298be-6a1b-4c88-a22f-32f630df57b0 req-ee41f53b-50dc-4004-bf10-1f0bb73be26e service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.428417 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-bff298be-6a1b-4c88-a22f-32f630df57b0 req-ee41f53b-50dc-4004-bf10-1f0bb73be26e service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.449536 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-bff298be-6a1b-4c88-a22f-32f630df57b0 req-ee41f53b-50dc-4004-bf10-1f0bb73be26e service nova] Creating event network-vif-plugged:e8b1fd5e-f836-49aa-8495-9b0aee05d3f4 for instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 on hv-cinder-83754 Jul 18 17:00:30.457468 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-bff298be-6a1b-4c88-a22f-32f630df57b0 req-ee41f53b-50dc-4004-bf10-1f0bb73be26e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057683 Jul 18 17:00:30.458174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 537/1081] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:30.459738 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d4590119-69c5-416e-8b21-b5932afc895a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:30.471743 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d4590119-69c5-416e-8b21-b5932afc895a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1362 microversion: 2.1 time: 0.222815 Jul 18 17:00:30.472622 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 545/1082] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:30 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:31.494559 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-80b167b1-6592-4c9c-a723-9fa57e5ee26a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:31.495274 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-80b167b1-6592-4c9c-a723-9fa57e5ee26a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:31.502751 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-80b167b1-6592-4c9c-a723-9fa57e5ee26a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:31.503205 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-80b167b1-6592-4c9c-a723-9fa57e5ee26a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:31.504024 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-80b167b1-6592-4c9c-a723-9fa57e5ee26a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:31.504414 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-80b167b1-6592-4c9c-a723-9fa57e5ee26a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:31.644511 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-80b167b1-6592-4c9c-a723-9fa57e5ee26a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:31.652576 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-80b167b1-6592-4c9c-a723-9fa57e5ee26a tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1362 microversion: 2.1 time: 0.162597 Jul 18 17:00:31.653191 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 538/1083] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:31 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:32.671204 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f316ad3f-b7b9-4049-af62-21afa3a8ef8e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:32.671817 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f316ad3f-b7b9-4049-af62-21afa3a8ef8e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:32.678702 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f316ad3f-b7b9-4049-af62-21afa3a8ef8e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:32.679141 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f316ad3f-b7b9-4049-af62-21afa3a8ef8e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:32.679927 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f316ad3f-b7b9-4049-af62-21afa3a8ef8e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:32.680350 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f316ad3f-b7b9-4049-af62-21afa3a8ef8e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:32.828372 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f316ad3f-b7b9-4049-af62-21afa3a8ef8e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:32.836944 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f316ad3f-b7b9-4049-af62-21afa3a8ef8e tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1362 microversion: 2.1 time: 0.170813 Jul 18 17:00:32.838152 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 546/1084] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:32 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:33.853912 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fbbf7c3c-8139-4c20-90d7-57d7481b77a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:33.854525 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fbbf7c3c-8139-4c20-90d7-57d7481b77a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:33.862432 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fbbf7c3c-8139-4c20-90d7-57d7481b77a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:33.867874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fbbf7c3c-8139-4c20-90d7-57d7481b77a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:33.867874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fbbf7c3c-8139-4c20-90d7-57d7481b77a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:33.867874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fbbf7c3c-8139-4c20-90d7-57d7481b77a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:34.005141 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fbbf7c3c-8139-4c20-90d7-57d7481b77a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:34.013390 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fbbf7c3c-8139-4c20-90d7-57d7481b77a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1548 microversion: 2.1 time: 0.163338 Jul 18 17:00:34.013970 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 539/1085] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:33 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:34.039306 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c95578e5-0316-447c-ae86-b82bb3ca25b7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:34.039886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c95578e5-0316-447c-ae86-b82bb3ca25b7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:34.047802 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c95578e5-0316-447c-ae86-b82bb3ca25b7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:34.048248 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c95578e5-0316-447c-ae86-b82bb3ca25b7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:34.049163 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c95578e5-0316-447c-ae86-b82bb3ca25b7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:34.049475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c95578e5-0316-447c-ae86-b82bb3ca25b7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:34.150548 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c95578e5-0316-447c-ae86-b82bb3ca25b7 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115144 Jul 18 17:00:34.157636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 547/1086] 10.222.0.76 () {58 vars in 1274 bytes} [Mon Jul 18 17:00:34 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:35.328687 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-25720af4-d871-47e0-be98-dc9281864659 req-08682d63-40d4-447e-bb08-f1de259b8a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "713eeca4-97c2-49c7-a6e6-a438f9b5c9d4", "tag": "e8b1fd5e-f836-49aa-8495-9b0aee05d3f4"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:35.348695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-25720af4-d871-47e0-be98-dc9281864659 req-08682d63-40d4-447e-bb08-f1de259b8a87 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:35.348695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-25720af4-d871-47e0-be98-dc9281864659 req-08682d63-40d4-447e-bb08-f1de259b8a87 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:35.358454 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-25720af4-d871-47e0-be98-dc9281864659 req-08682d63-40d4-447e-bb08-f1de259b8a87 service nova] Creating event network-changed:e8b1fd5e-f836-49aa-8495-9b0aee05d3f4 for instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 on hv-cinder-83754 Jul 18 17:00:35.364253 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-25720af4-d871-47e0-be98-dc9281864659 req-08682d63-40d4-447e-bb08-f1de259b8a87 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041052 Jul 18 17:00:35.364856 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 540/1087] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:43.569182 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1d09824e-c9a8-4083-a693-1218b323f95b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:43.569730 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1d09824e-c9a8-4083-a693-1218b323f95b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:43.576755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d09824e-c9a8-4083-a693-1218b323f95b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:43.577230 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d09824e-c9a8-4083-a693-1218b323f95b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:43.577991 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d09824e-c9a8-4083-a693-1218b323f95b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:43.578449 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d09824e-c9a8-4083-a693-1218b323f95b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:43.601882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1d09824e-c9a8-4083-a693-1218b323f95b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/ips" status: 200 len: 153 microversion: 2.20 time: 0.037682 Jul 18 17:00:43.602458 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 548/1088] 10.222.0.76 () {60 vars in 1288 bytes} [Mon Jul 18 17:00:43 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 17:00:46.664065 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1549514541", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1291189408", "security_groups": [{"name": "tempest-secgroup-smoke-806392402"}], "block_device_mapping_v2": [{"uuid": "9aa836dd-c07d-4b69-8c76-2eaaac13d685", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ed716b42-439d-44c6-b097-74d923cb2bde"}]}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:46.672365 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=7 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:46.673032 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=50 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:46.783637 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] validate_networks() for [('ed716b42-439d-44c6-b097-74d923cb2bde', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:00:47.162630 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:00:47.163093 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:00:47.163574 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:00:47.163989 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:00:47.164409 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:00:47.174484 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:47.175210 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:47.175737 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:47.176182 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:47.194155 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Getting quotas for project 997c256859f2484e8465c043b3d2299d. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:00:47.203358 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Getting quotas for user 4ad27549c1824d45b1d55653e2c121a8 and project 997c256859f2484e8465c043b3d2299d. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:00:47.256823 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:00:47.259030 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9aa836dd-c07d-4b69-8c76-2eaaac13d685',volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:00:47.701735 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4b386037-0e1c-4533-83d8-66dee1fcb025 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.042077 Jul 18 17:00:47.705062 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 541/1089] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 17:00:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 17:00:47.712506 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-698d1251-3849-4532-afc9-b4e53b8bb9a9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:47.713138 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-698d1251-3849-4532-afc9-b4e53b8bb9a9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:47.768204 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-698d1251-3849-4532-afc9-b4e53b8bb9a9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:47.776560 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-698d1251-3849-4532-afc9-b4e53b8bb9a9 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1095 microversion: 2.1 time: 0.067496 Jul 18 17:00:47.776807 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 549/1090] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:47 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:48.110901 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-968c2c3a-a88d-40c6-8c26-b8139c12fb8d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:48.111646 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-968c2c3a-a88d-40c6-8c26-b8139c12fb8d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:48.118753 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-968c2c3a-a88d-40c6-8c26-b8139c12fb8d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:48.119200 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-968c2c3a-a88d-40c6-8c26-b8139c12fb8d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:48.119964 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-968c2c3a-a88d-40c6-8c26-b8139c12fb8d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:48.120406 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-968c2c3a-a88d-40c6-8c26-b8139c12fb8d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:48.143981 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-968c2c3a-a88d-40c6-8c26-b8139c12fb8d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lazy-loading 'flavor' on Instance uuid f55db823-1c00-4ca0-bc6f-cd070459c5e9 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:00:48.794012 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f354ecde-1d33-4d93-9690-12a84b2fa322 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:48.794786 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f354ecde-1d33-4d93-9690-12a84b2fa322 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:48.802155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f354ecde-1d33-4d93-9690-12a84b2fa322 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:48.802617 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f354ecde-1d33-4d93-9690-12a84b2fa322 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:48.803403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f354ecde-1d33-4d93-9690-12a84b2fa322 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:48.803848 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f354ecde-1d33-4d93-9690-12a84b2fa322 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:48.861623 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-968c2c3a-a88d-40c6-8c26-b8139c12fb8d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "POST /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/action" status: 202 len: 0 microversion: 2.20 time: 0.754644 Jul 18 17:00:48.865862 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 542/1091] 10.222.0.76 () {62 vars in 1318 bytes} [Mon Jul 18 17:00:48 2022] POST /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:00:48.871470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3ab7a127-ead2-4dd9-ab30-401ccda8745b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:48.872613 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3ab7a127-ead2-4dd9-ab30-401ccda8745b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:48.876776 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f354ecde-1d33-4d93-9690-12a84b2fa322 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:48.880808 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ab7a127-ead2-4dd9-ab30-401ccda8745b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:48.881565 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ab7a127-ead2-4dd9-ab30-401ccda8745b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:48.882587 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ab7a127-ead2-4dd9-ab30-401ccda8745b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:48.883234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ab7a127-ead2-4dd9-ab30-401ccda8745b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:48.892168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f354ecde-1d33-4d93-9690-12a84b2fa322 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1145 microversion: 2.1 time: 0.102194 Jul 18 17:00:48.902725 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 550/1092] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:48 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1145 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:00:49.033857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3ab7a127-ead2-4dd9-ab30-401ccda8745b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:49.041919 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3ab7a127-ead2-4dd9-ab30-401ccda8745b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:49.043421 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3ab7a127-ead2-4dd9-ab30-401ccda8745b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:49.044909 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3ab7a127-ead2-4dd9-ab30-401ccda8745b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.177579 Jul 18 17:00:49.045505 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 543/1093] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:48 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:49.910212 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2e0952f1-a70e-4afd-b91b-c405b008403a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:49.910767 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2e0952f1-a70e-4afd-b91b-c405b008403a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:49.917425 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2e0952f1-a70e-4afd-b91b-c405b008403a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:49.917893 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2e0952f1-a70e-4afd-b91b-c405b008403a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:49.918668 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2e0952f1-a70e-4afd-b91b-c405b008403a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:49.919347 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2e0952f1-a70e-4afd-b91b-c405b008403a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:49.986720 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2e0952f1-a70e-4afd-b91b-c405b008403a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:49.994631 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2e0952f1-a70e-4afd-b91b-c405b008403a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1193 microversion: 2.1 time: 0.088717 Jul 18 17:00:49.995202 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 551/1094] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:49 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:50.064448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-79e248df-3936-41a7-8ef2-56ffda166ea4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:50.065073 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-79e248df-3936-41a7-8ef2-56ffda166ea4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:50.071746 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-79e248df-3936-41a7-8ef2-56ffda166ea4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:50.072189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-79e248df-3936-41a7-8ef2-56ffda166ea4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:50.072944 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-79e248df-3936-41a7-8ef2-56ffda166ea4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:50.073419 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-79e248df-3936-41a7-8ef2-56ffda166ea4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:50.220870 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-79e248df-3936-41a7-8ef2-56ffda166ea4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:50.230551 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-79e248df-3936-41a7-8ef2-56ffda166ea4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:50.232841 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-79e248df-3936-41a7-8ef2-56ffda166ea4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:50.234057 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-79e248df-3936-41a7-8ef2-56ffda166ea4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.174336 Jul 18 17:00:50.234634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 544/1095] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:50 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:51.012211 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-413d7454-c7d6-420f-8c82-bf9e231b1f31 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:51.013383 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-413d7454-c7d6-420f-8c82-bf9e231b1f31 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:51.019978 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-413d7454-c7d6-420f-8c82-bf9e231b1f31 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:51.020434 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-413d7454-c7d6-420f-8c82-bf9e231b1f31 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:51.021884 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-413d7454-c7d6-420f-8c82-bf9e231b1f31 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:51.022382 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-413d7454-c7d6-420f-8c82-bf9e231b1f31 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:51.092997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-413d7454-c7d6-420f-8c82-bf9e231b1f31 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:51.100800 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-413d7454-c7d6-420f-8c82-bf9e231b1f31 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1211 microversion: 2.1 time: 0.092552 Jul 18 17:00:51.101432 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 552/1096] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:51 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:51.253208 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b04d5fe0-4bb0-48d0-a6d1-d194b0254435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:51.253868 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b04d5fe0-4bb0-48d0-a6d1-d194b0254435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:51.260574 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b04d5fe0-4bb0-48d0-a6d1-d194b0254435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:51.260991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b04d5fe0-4bb0-48d0-a6d1-d194b0254435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:51.261830 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b04d5fe0-4bb0-48d0-a6d1-d194b0254435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:51.262274 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b04d5fe0-4bb0-48d0-a6d1-d194b0254435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:51.410208 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b04d5fe0-4bb0-48d0-a6d1-d194b0254435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:51.418160 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b04d5fe0-4bb0-48d0-a6d1-d194b0254435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:51.419994 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b04d5fe0-4bb0-48d0-a6d1-d194b0254435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:51.421272 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b04d5fe0-4bb0-48d0-a6d1-d194b0254435 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.172020 Jul 18 17:00:51.421904 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 545/1097] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:51 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:52.120511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b25d702d-e206-4ad6-83f2-2d1337a40b62 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:52.120511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b25d702d-e206-4ad6-83f2-2d1337a40b62 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:52.126108 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b25d702d-e206-4ad6-83f2-2d1337a40b62 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:52.126563 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b25d702d-e206-4ad6-83f2-2d1337a40b62 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:52.127386 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b25d702d-e206-4ad6-83f2-2d1337a40b62 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:52.127864 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b25d702d-e206-4ad6-83f2-2d1337a40b62 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:52.265039 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b25d702d-e206-4ad6-83f2-2d1337a40b62 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:52.272897 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b25d702d-e206-4ad6-83f2-2d1337a40b62 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1278 microversion: 2.1 time: 0.158548 Jul 18 17:00:52.283122 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 553/1098] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:52 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:00:52.441135 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2148163d-b734-4924-8007-533213e18892 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:52.441906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2148163d-b734-4924-8007-533213e18892 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:52.448921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2148163d-b734-4924-8007-533213e18892 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:52.449549 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2148163d-b734-4924-8007-533213e18892 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:52.451551 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2148163d-b734-4924-8007-533213e18892 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:52.452191 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2148163d-b734-4924-8007-533213e18892 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:52.641511 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2148163d-b734-4924-8007-533213e18892 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:52.649790 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2148163d-b734-4924-8007-533213e18892 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:52.651408 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2148163d-b734-4924-8007-533213e18892 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:52.652553 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2148163d-b734-4924-8007-533213e18892 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.215817 Jul 18 17:00:52.653210 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 546/1099] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:52 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:52.748083 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-5b6fdd95-08b4-45ca-89d6-977582008f14 req-628b0cee-6ea5-4fe8-96dc-85df00d515d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58499c89-21dc-4a75-9cae-b2cc7f7e90b9", "tag": "38df9321-fcab-4ab6-a5e8-5f70fc544990"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:52.762612 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-5b6fdd95-08b4-45ca-89d6-977582008f14 req-628b0cee-6ea5-4fe8-96dc-85df00d515d0 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:52.763130 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-5b6fdd95-08b4-45ca-89d6-977582008f14 req-628b0cee-6ea5-4fe8-96dc-85df00d515d0 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:52.776380 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-5b6fdd95-08b4-45ca-89d6-977582008f14 req-628b0cee-6ea5-4fe8-96dc-85df00d515d0 service nova] Creating event network-changed:38df9321-fcab-4ab6-a5e8-5f70fc544990 for instance 58499c89-21dc-4a75-9cae-b2cc7f7e90b9 on hv-cinder-83754 Jul 18 17:00:52.782104 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-5b6fdd95-08b4-45ca-89d6-977582008f14 req-628b0cee-6ea5-4fe8-96dc-85df00d515d0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038133 Jul 18 17:00:52.782522 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 554/1100] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:00:53.291163 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dd99941e-4dd1-447e-a5bc-208d09de3df0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:53.299634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dd99941e-4dd1-447e-a5bc-208d09de3df0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:53.299634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dd99941e-4dd1-447e-a5bc-208d09de3df0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:53.299634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dd99941e-4dd1-447e-a5bc-208d09de3df0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:53.299634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dd99941e-4dd1-447e-a5bc-208d09de3df0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:53.300068 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dd99941e-4dd1-447e-a5bc-208d09de3df0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:53.531590 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dd99941e-4dd1-447e-a5bc-208d09de3df0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:53.539398 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dd99941e-4dd1-447e-a5bc-208d09de3df0 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.252209 Jul 18 17:00:53.540392 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 547/1101] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:53 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:53.672978 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b01d0943-a57c-4e66-84a3-568370173f8a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:53.677919 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b01d0943-a57c-4e66-84a3-568370173f8a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:53.680233 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b01d0943-a57c-4e66-84a3-568370173f8a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:53.680707 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b01d0943-a57c-4e66-84a3-568370173f8a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:53.681505 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b01d0943-a57c-4e66-84a3-568370173f8a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:53.681948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b01d0943-a57c-4e66-84a3-568370173f8a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:53.828305 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b01d0943-a57c-4e66-84a3-568370173f8a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:53.836175 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b01d0943-a57c-4e66-84a3-568370173f8a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:53.837703 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b01d0943-a57c-4e66-84a3-568370173f8a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:53.838864 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b01d0943-a57c-4e66-84a3-568370173f8a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.170983 Jul 18 17:00:53.839415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 555/1102] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:53 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:54.558219 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-43c97b3a-8749-40a3-b4d7-8fcb3dbbf658 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:54.558849 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-43c97b3a-8749-40a3-b4d7-8fcb3dbbf658 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:54.566071 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43c97b3a-8749-40a3-b4d7-8fcb3dbbf658 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:54.566520 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43c97b3a-8749-40a3-b4d7-8fcb3dbbf658 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:54.567285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43c97b3a-8749-40a3-b4d7-8fcb3dbbf658 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:54.567727 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43c97b3a-8749-40a3-b4d7-8fcb3dbbf658 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:54.701162 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-43c97b3a-8749-40a3-b4d7-8fcb3dbbf658 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:54.708661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-43c97b3a-8749-40a3-b4d7-8fcb3dbbf658 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.154544 Jul 18 17:00:54.709262 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 548/1103] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:54 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:54.858950 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a95ad905-8194-4aee-bc9d-d5df2f804bdb tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:54.859523 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a95ad905-8194-4aee-bc9d-d5df2f804bdb tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:54.866530 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a95ad905-8194-4aee-bc9d-d5df2f804bdb tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:54.866984 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a95ad905-8194-4aee-bc9d-d5df2f804bdb tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:54.867819 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a95ad905-8194-4aee-bc9d-d5df2f804bdb tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:54.869301 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a95ad905-8194-4aee-bc9d-d5df2f804bdb tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:55.002090 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a95ad905-8194-4aee-bc9d-d5df2f804bdb tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:55.010007 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a95ad905-8194-4aee-bc9d-d5df2f804bdb tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:55.011534 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a95ad905-8194-4aee-bc9d-d5df2f804bdb tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:55.012863 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a95ad905-8194-4aee-bc9d-d5df2f804bdb tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.158401 Jul 18 17:00:55.013543 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 556/1104] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:54 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:55.725544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b22e7954-111c-4ce8-86cc-2b4fe33f7dbd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:55.726141 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b22e7954-111c-4ce8-86cc-2b4fe33f7dbd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:55.733188 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b22e7954-111c-4ce8-86cc-2b4fe33f7dbd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:55.733643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b22e7954-111c-4ce8-86cc-2b4fe33f7dbd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:55.734402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b22e7954-111c-4ce8-86cc-2b4fe33f7dbd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:55.734838 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b22e7954-111c-4ce8-86cc-2b4fe33f7dbd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:55.872984 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b22e7954-111c-4ce8-86cc-2b4fe33f7dbd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:55.880581 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b22e7954-111c-4ce8-86cc-2b4fe33f7dbd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.158897 Jul 18 17:00:55.881171 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 549/1105] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:55 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:56.031263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5a82aa35-c4f7-46be-948e-c4e14dace348 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:56.031942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5a82aa35-c4f7-46be-948e-c4e14dace348 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:56.038927 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a82aa35-c4f7-46be-948e-c4e14dace348 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:56.039388 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a82aa35-c4f7-46be-948e-c4e14dace348 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:56.040236 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a82aa35-c4f7-46be-948e-c4e14dace348 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:56.040667 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a82aa35-c4f7-46be-948e-c4e14dace348 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:56.180315 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5a82aa35-c4f7-46be-948e-c4e14dace348 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:56.188661 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5a82aa35-c4f7-46be-948e-c4e14dace348 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:56.190195 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5a82aa35-c4f7-46be-948e-c4e14dace348 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:56.191393 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5a82aa35-c4f7-46be-948e-c4e14dace348 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.164973 Jul 18 17:00:56.191939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 557/1106] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:56 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:56.898656 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5d6674a7-ff93-43ee-b482-d4513b2922e7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:56.899212 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5d6674a7-ff93-43ee-b482-d4513b2922e7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:56.906134 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d6674a7-ff93-43ee-b482-d4513b2922e7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:56.906580 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d6674a7-ff93-43ee-b482-d4513b2922e7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:56.907632 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d6674a7-ff93-43ee-b482-d4513b2922e7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:56.908302 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d6674a7-ff93-43ee-b482-d4513b2922e7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:57.045562 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5d6674a7-ff93-43ee-b482-d4513b2922e7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:57.053136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5d6674a7-ff93-43ee-b482-d4513b2922e7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.158381 Jul 18 17:00:57.053718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 550/1107] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:56 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:57.210015 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-86d54dc2-05d9-43ad-9775-b84b11631da3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:57.210655 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-86d54dc2-05d9-43ad-9775-b84b11631da3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:57.217991 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86d54dc2-05d9-43ad-9775-b84b11631da3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:57.218440 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86d54dc2-05d9-43ad-9775-b84b11631da3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:57.219200 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86d54dc2-05d9-43ad-9775-b84b11631da3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:57.219633 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86d54dc2-05d9-43ad-9775-b84b11631da3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:57.354705 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-86d54dc2-05d9-43ad-9775-b84b11631da3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:57.363394 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-86d54dc2-05d9-43ad-9775-b84b11631da3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:57.364938 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-86d54dc2-05d9-43ad-9775-b84b11631da3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:57.366143 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-86d54dc2-05d9-43ad-9775-b84b11631da3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.160137 Jul 18 17:00:57.366964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 558/1108] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:57 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:57.550972 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-df842398-5916-4d97-9e45-ddc960378278 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:57.551466 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-df842398-5916-4d97-9e45-ddc960378278 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:57.553515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:57.554190 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=6 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:57.562884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df842398-5916-4d97-9e45-ddc960378278 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:57.562884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df842398-5916-4d97-9e45-ddc960378278 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:57.562884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df842398-5916-4d97-9e45-ddc960378278 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:57.562884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df842398-5916-4d97-9e45-ddc960378278 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:57.589060 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-df842398-5916-4d97-9e45-ddc960378278 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/ips" status: 200 len: 150 microversion: 2.1 time: 0.041948 Jul 18 17:00:57.589680 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 551/1109] 10.222.0.76 () {58 vars in 1247 bytes} [Mon Jul 18 17:00:57 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:58.070469 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f888a30a-977f-4375-b7fe-101ef9c9bcc8 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:58.071078 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f888a30a-977f-4375-b7fe-101ef9c9bcc8 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:58.073089 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:58.077994 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f888a30a-977f-4375-b7fe-101ef9c9bcc8 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:58.078477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f888a30a-977f-4375-b7fe-101ef9c9bcc8 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:58.079218 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f888a30a-977f-4375-b7fe-101ef9c9bcc8 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:58.079652 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f888a30a-977f-4375-b7fe-101ef9c9bcc8 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:58.082330 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=79 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:58.223745 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f888a30a-977f-4375-b7fe-101ef9c9bcc8 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:58.231705 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f888a30a-977f-4375-b7fe-101ef9c9bcc8 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.164552 Jul 18 17:00:58.233042 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 559/1110] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:58 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:58.386257 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5d3abffa-d454-418d-9b87-8c0c437463bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:58.387590 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5d3abffa-d454-418d-9b87-8c0c437463bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:58.395528 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d3abffa-d454-418d-9b87-8c0c437463bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:58.396002 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d3abffa-d454-418d-9b87-8c0c437463bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:58.396768 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d3abffa-d454-418d-9b87-8c0c437463bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:58.397234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d3abffa-d454-418d-9b87-8c0c437463bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:58.534524 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5d3abffa-d454-418d-9b87-8c0c437463bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:58.542837 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5d3abffa-d454-418d-9b87-8c0c437463bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:58.544954 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5d3abffa-d454-418d-9b87-8c0c437463bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:58.546130 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5d3abffa-d454-418d-9b87-8c0c437463bc tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.164158 Jul 18 17:00:58.546696 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 552/1111] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:58 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:59.250329 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2c9ff487-6cc2-46f5-b0bb-aea736fb2b98 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:59.250932 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2c9ff487-6cc2-46f5-b0bb-aea736fb2b98 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:59.259125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c9ff487-6cc2-46f5-b0bb-aea736fb2b98 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:59.261244 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c9ff487-6cc2-46f5-b0bb-aea736fb2b98 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:59.261244 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c9ff487-6cc2-46f5-b0bb-aea736fb2b98 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:59.261244 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c9ff487-6cc2-46f5-b0bb-aea736fb2b98 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:59.400628 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2c9ff487-6cc2-46f5-b0bb-aea736fb2b98 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:59.409178 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2c9ff487-6cc2-46f5-b0bb-aea736fb2b98 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.163121 Jul 18 17:00:59.410341 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 560/1112] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:59 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:59.563833 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a682ddc1-82b2-467b-8d7c-2056fbd179be tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:59.564440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a682ddc1-82b2-467b-8d7c-2056fbd179be tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:59.570961 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a682ddc1-82b2-467b-8d7c-2056fbd179be tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:59.571410 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a682ddc1-82b2-467b-8d7c-2056fbd179be tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:59.572177 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a682ddc1-82b2-467b-8d7c-2056fbd179be tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:59.572614 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a682ddc1-82b2-467b-8d7c-2056fbd179be tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:59.711957 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a682ddc1-82b2-467b-8d7c-2056fbd179be tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:59.720544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a682ddc1-82b2-467b-8d7c-2056fbd179be tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:59.722056 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a682ddc1-82b2-467b-8d7c-2056fbd179be tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:59.723210 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a682ddc1-82b2-467b-8d7c-2056fbd179be tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.163322 Jul 18 17:00:59.723799 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 553/1113] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:59 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:00.425815 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6afa69c4-4430-4be4-a96e-ca8c9540444f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:00.426433 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6afa69c4-4430-4be4-a96e-ca8c9540444f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:00.429358 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-13f6dc99-dc79-47aa-acd3-58280492d5fe tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f807309-b044-4e3f-a065-7a09810e7e6f"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:00.430468 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-13f6dc99-dc79-47aa-acd3-58280492d5fe tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:00.433848 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6afa69c4-4430-4be4-a96e-ca8c9540444f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:00.434831 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6afa69c4-4430-4be4-a96e-ca8c9540444f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:00.435827 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6afa69c4-4430-4be4-a96e-ca8c9540444f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:00.436605 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6afa69c4-4430-4be4-a96e-ca8c9540444f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:00.437103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13f6dc99-dc79-47aa-acd3-58280492d5fe tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:00.437559 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13f6dc99-dc79-47aa-acd3-58280492d5fe tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:00.438389 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13f6dc99-dc79-47aa-acd3-58280492d5fe tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:00.438793 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13f6dc99-dc79-47aa-acd3-58280492d5fe tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:00.593407 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6afa69c4-4430-4be4-a96e-ca8c9540444f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:00.601294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6afa69c4-4430-4be4-a96e-ca8c9540444f tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.179341 Jul 18 17:01:00.601869 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 561/1114] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:00 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:00.742202 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3e000d1f-d6fd-4636-9941-58f3955e5a0a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:00.742577 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3e000d1f-d6fd-4636-9941-58f3955e5a0a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:00.748789 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3e000d1f-d6fd-4636-9941-58f3955e5a0a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:00.749292 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3e000d1f-d6fd-4636-9941-58f3955e5a0a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:00.753901 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3e000d1f-d6fd-4636-9941-58f3955e5a0a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:00.753901 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3e000d1f-d6fd-4636-9941-58f3955e5a0a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:00.893292 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3e000d1f-d6fd-4636-9941-58f3955e5a0a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:00.901587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3e000d1f-d6fd-4636-9941-58f3955e5a0a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:00.903839 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3e000d1f-d6fd-4636-9941-58f3955e5a0a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:00.905152 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3e000d1f-d6fd-4636-9941-58f3955e5a0a tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.167432 Jul 18 17:01:00.905712 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 562/1115] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:00 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:01:01.619047 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f27d1612-db4b-4c4e-b5e2-ef0f182dd902 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:01.619893 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f27d1612-db4b-4c4e-b5e2-ef0f182dd902 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:01.626820 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f27d1612-db4b-4c4e-b5e2-ef0f182dd902 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:01.627286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f27d1612-db4b-4c4e-b5e2-ef0f182dd902 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:01.628075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f27d1612-db4b-4c4e-b5e2-ef0f182dd902 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:01.628642 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f27d1612-db4b-4c4e-b5e2-ef0f182dd902 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:01.765619 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f27d1612-db4b-4c4e-b5e2-ef0f182dd902 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:01.773686 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f27d1612-db4b-4c4e-b5e2-ef0f182dd902 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.158403 Jul 18 17:01:01.774284 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 563/1116] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:01 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:01.924009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ae6ca1ce-24e2-42a5-9f43-74355db970ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:01.924689 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ae6ca1ce-24e2-42a5-9f43-74355db970ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:01.930923 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae6ca1ce-24e2-42a5-9f43-74355db970ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:01.931375 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae6ca1ce-24e2-42a5-9f43-74355db970ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:01.932143 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae6ca1ce-24e2-42a5-9f43-74355db970ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:01.932584 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae6ca1ce-24e2-42a5-9f43-74355db970ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:02.070140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ae6ca1ce-24e2-42a5-9f43-74355db970ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:02.078634 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ae6ca1ce-24e2-42a5-9f43-74355db970ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:02.080309 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ae6ca1ce-24e2-42a5-9f43-74355db970ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:02.082277 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ae6ca1ce-24e2-42a5-9f43-74355db970ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.162189 Jul 18 17:01:02.083276 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 564/1117] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:01 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:01:02.445688 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-13f6dc99-dc79-47aa-acd3-58280492d5fe tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "POST /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.020036 Jul 18 17:01:02.446317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 554/1118] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 17:01:00 2022] POST /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments => generated 194 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:02.791701 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fc06e865-4188-4cab-bea1-a78777b26213 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:02.792402 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fc06e865-4188-4cab-bea1-a78777b26213 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:02.799311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc06e865-4188-4cab-bea1-a78777b26213 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:02.799761 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc06e865-4188-4cab-bea1-a78777b26213 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:02.800706 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc06e865-4188-4cab-bea1-a78777b26213 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:02.801214 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc06e865-4188-4cab-bea1-a78777b26213 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:03.042999 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fc06e865-4188-4cab-bea1-a78777b26213 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:03.050671 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fc06e865-4188-4cab-bea1-a78777b26213 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.262959 Jul 18 17:01:03.054085 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 565/1119] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:02 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:03.102027 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a145c3d3-ffb9-45da-8550-6f193ef931f0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:03.102616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a145c3d3-ffb9-45da-8550-6f193ef931f0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:03.109360 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a145c3d3-ffb9-45da-8550-6f193ef931f0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:03.109803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a145c3d3-ffb9-45da-8550-6f193ef931f0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:03.110604 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a145c3d3-ffb9-45da-8550-6f193ef931f0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:03.111295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a145c3d3-ffb9-45da-8550-6f193ef931f0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:03.116227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:03.257981 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a145c3d3-ffb9-45da-8550-6f193ef931f0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:03.267129 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a145c3d3-ffb9-45da-8550-6f193ef931f0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:03.268677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a145c3d3-ffb9-45da-8550-6f193ef931f0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:03.269903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a145c3d3-ffb9-45da-8550-6f193ef931f0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.172758 Jul 18 17:01:03.270506 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 555/1120] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:03 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:04.068863 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b16b3c16-ee1b-4dcb-8816-d8e83b93e481 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:04.069513 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b16b3c16-ee1b-4dcb-8816-d8e83b93e481 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:04.076889 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b16b3c16-ee1b-4dcb-8816-d8e83b93e481 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:04.077381 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b16b3c16-ee1b-4dcb-8816-d8e83b93e481 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:04.078168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b16b3c16-ee1b-4dcb-8816-d8e83b93e481 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:04.078617 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b16b3c16-ee1b-4dcb-8816-d8e83b93e481 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:04.229298 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b16b3c16-ee1b-4dcb-8816-d8e83b93e481 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:04.238782 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b16b3c16-ee1b-4dcb-8816-d8e83b93e481 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.173768 Jul 18 17:01:04.239275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 566/1121] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:04 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:04.289749 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5c41b94e-fdfa-4267-a1f7-2d0f6c2d9d5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:04.290435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5c41b94e-fdfa-4267-a1f7-2d0f6c2d9d5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:04.297859 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c41b94e-fdfa-4267-a1f7-2d0f6c2d9d5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:04.298359 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c41b94e-fdfa-4267-a1f7-2d0f6c2d9d5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:04.299137 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c41b94e-fdfa-4267-a1f7-2d0f6c2d9d5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:04.299767 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c41b94e-fdfa-4267-a1f7-2d0f6c2d9d5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:04.538342 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5c41b94e-fdfa-4267-a1f7-2d0f6c2d9d5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:04.547827 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5c41b94e-fdfa-4267-a1f7-2d0f6c2d9d5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:04.549491 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5c41b94e-fdfa-4267-a1f7-2d0f6c2d9d5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:04.550898 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5c41b94e-fdfa-4267-a1f7-2d0f6c2d9d5f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.265414 Jul 18 17:01:04.551846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 556/1122] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:04 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:05.258630 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-65baa0a6-d2da-49b5-8213-4e73a6b58544 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:05.259121 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-65baa0a6-d2da-49b5-8213-4e73a6b58544 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:05.266391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-88b9b21f-900d-407b-b06a-9458a0d76b64 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:05.267019 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-88b9b21f-900d-407b-b06a-9458a0d76b64 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:05.273327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65baa0a6-d2da-49b5-8213-4e73a6b58544 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:05.273788 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65baa0a6-d2da-49b5-8213-4e73a6b58544 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:05.274570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65baa0a6-d2da-49b5-8213-4e73a6b58544 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:05.275013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65baa0a6-d2da-49b5-8213-4e73a6b58544 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:05.282575 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88b9b21f-900d-407b-b06a-9458a0d76b64 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:05.283026 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88b9b21f-900d-407b-b06a-9458a0d76b64 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:05.283800 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88b9b21f-900d-407b-b06a-9458a0d76b64 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:05.284400 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88b9b21f-900d-407b-b06a-9458a0d76b64 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:05.301979 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-65baa0a6-d2da-49b5-8213-4e73a6b58544 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:01:05.430975 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-88b9b21f-900d-407b-b06a-9458a0d76b64 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:05.447375 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-88b9b21f-900d-407b-b06a-9458a0d76b64 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.185795 Jul 18 17:01:05.448017 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 557/1123] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:05 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:05.453372 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-62296e4e-699b-4d20-b06a-ee884a4c6243 req-08eb672e-ab9d-4ce1-a5c7-87d13bf15c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d25fa4-9505-4471-a0be-e3a486297f2d", "tag": "f3c39284-35e1-4778-990a-0024c4b94641"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:05.462068 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-62296e4e-699b-4d20-b06a-ee884a4c6243 req-08eb672e-ab9d-4ce1-a5c7-87d13bf15c3a service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:05.462528 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-62296e4e-699b-4d20-b06a-ee884a4c6243 req-08eb672e-ab9d-4ce1-a5c7-87d13bf15c3a service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:05.477686 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-62296e4e-699b-4d20-b06a-ee884a4c6243 req-08eb672e-ab9d-4ce1-a5c7-87d13bf15c3a service nova] Creating event network-changed:f3c39284-35e1-4778-990a-0024c4b94641 for instance 87d25fa4-9505-4471-a0be-e3a486297f2d on hv-cinder-83754 Jul 18 17:01:05.482948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-62296e4e-699b-4d20-b06a-ee884a4c6243 req-08eb672e-ab9d-4ce1-a5c7-87d13bf15c3a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033771 Jul 18 17:01:05.483549 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 558/1124] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:05.571072 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ac0b7d32-758e-413c-b058-4faad4381f9b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:05.571939 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ac0b7d32-758e-413c-b058-4faad4381f9b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:05.579710 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac0b7d32-758e-413c-b058-4faad4381f9b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:05.580336 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac0b7d32-758e-413c-b058-4faad4381f9b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:05.581851 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac0b7d32-758e-413c-b058-4faad4381f9b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:05.582568 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac0b7d32-758e-413c-b058-4faad4381f9b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:05.692054 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-65baa0a6-d2da-49b5-8213-4e73a6b58544 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "DELETE /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 204 len: 0 microversion: 2.1 time: 0.427629 Jul 18 17:01:05.692054 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 567/1125] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:01:05 2022] DELETE /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:01:05.696233 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f16060ff-e981-4018-83d0-3b930a749ca9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:05.697066 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f16060ff-e981-4018-83d0-3b930a749ca9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:05.705981 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f16060ff-e981-4018-83d0-3b930a749ca9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:05.706545 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f16060ff-e981-4018-83d0-3b930a749ca9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:05.707684 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f16060ff-e981-4018-83d0-3b930a749ca9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:05.708236 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f16060ff-e981-4018-83d0-3b930a749ca9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:05.789787 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ac0b7d32-758e-413c-b058-4faad4381f9b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:05.799133 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ac0b7d32-758e-413c-b058-4faad4381f9b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:05.800982 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ac0b7d32-758e-413c-b058-4faad4381f9b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:05.802204 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ac0b7d32-758e-413c-b058-4faad4381f9b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.236936 Jul 18 17:01:05.802972 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 559/1126] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:05 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:01:05.881679 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f16060ff-e981-4018-83d0-3b930a749ca9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:05.892506 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f16060ff-e981-4018-83d0-3b930a749ca9 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.202216 Jul 18 17:01:05.893526 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 568/1127] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:05 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:06.465644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2bcf3ed7-4876-4ab3-9caf-d7ad93051845 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:06.466402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2bcf3ed7-4876-4ab3-9caf-d7ad93051845 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:06.473979 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2bcf3ed7-4876-4ab3-9caf-d7ad93051845 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:06.474676 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2bcf3ed7-4876-4ab3-9caf-d7ad93051845 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:06.475636 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2bcf3ed7-4876-4ab3-9caf-d7ad93051845 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:06.476252 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2bcf3ed7-4876-4ab3-9caf-d7ad93051845 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:06.623782 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2bcf3ed7-4876-4ab3-9caf-d7ad93051845 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:06.629838 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2bcf3ed7-4876-4ab3-9caf-d7ad93051845 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.168670 Jul 18 17:01:06.630968 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 560/1128] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:06 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:06.822168 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-29ca392d-0897-468f-a610-6136472ee34e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:06.822911 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-29ca392d-0897-468f-a610-6136472ee34e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:06.830484 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29ca392d-0897-468f-a610-6136472ee34e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:06.834346 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29ca392d-0897-468f-a610-6136472ee34e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:06.834346 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29ca392d-0897-468f-a610-6136472ee34e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:06.834346 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29ca392d-0897-468f-a610-6136472ee34e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:06.910589 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b9c7912d-2166-4b60-b82e-28cff9aaf34e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:06.911493 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b9c7912d-2166-4b60-b82e-28cff9aaf34e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:06.917594 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b9c7912d-2166-4b60-b82e-28cff9aaf34e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:06.918346 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b9c7912d-2166-4b60-b82e-28cff9aaf34e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:06.919116 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b9c7912d-2166-4b60-b82e-28cff9aaf34e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:06.919556 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b9c7912d-2166-4b60-b82e-28cff9aaf34e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:06.994617 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-29ca392d-0897-468f-a610-6136472ee34e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:07.003145 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-29ca392d-0897-468f-a610-6136472ee34e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:07.004772 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-29ca392d-0897-468f-a610-6136472ee34e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:07.006146 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-29ca392d-0897-468f-a610-6136472ee34e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1746 microversion: 2.20 time: 0.188177 Jul 18 17:01:07.006848 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 569/1129] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:06 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1746 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:07.156795 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b9c7912d-2166-4b60-b82e-28cff9aaf34e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:07.164584 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b9c7912d-2166-4b60-b82e-28cff9aaf34e tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.257926 Jul 18 17:01:07.165189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 561/1130] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:06 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:07.646944 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2b30c81b-6608-4f38-8139-f2b41d0a362c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:07.647556 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2b30c81b-6608-4f38-8139-f2b41d0a362c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:07.654484 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b30c81b-6608-4f38-8139-f2b41d0a362c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:07.654937 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b30c81b-6608-4f38-8139-f2b41d0a362c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:07.655711 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b30c81b-6608-4f38-8139-f2b41d0a362c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:07.656156 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b30c81b-6608-4f38-8139-f2b41d0a362c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:07.793714 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2b30c81b-6608-4f38-8139-f2b41d0a362c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:07.804037 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2b30c81b-6608-4f38-8139-f2b41d0a362c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.160863 Jul 18 17:01:07.804859 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 570/1131] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:07 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:08.026428 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-767e7fe9-38ed-4fa7-8001-3bf85b229013 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:08.027081 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-767e7fe9-38ed-4fa7-8001-3bf85b229013 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:08.034573 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-767e7fe9-38ed-4fa7-8001-3bf85b229013 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:08.035023 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-767e7fe9-38ed-4fa7-8001-3bf85b229013 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:08.036914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-767e7fe9-38ed-4fa7-8001-3bf85b229013 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:08.036914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-767e7fe9-38ed-4fa7-8001-3bf85b229013 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:08.178169 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-767e7fe9-38ed-4fa7-8001-3bf85b229013 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:08.182925 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dcd48fae-eca7-4e25-8612-ca28cd439313 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:08.183608 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dcd48fae-eca7-4e25-8612-ca28cd439313 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:08.187151 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-767e7fe9-38ed-4fa7-8001-3bf85b229013 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:08.188709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-767e7fe9-38ed-4fa7-8001-3bf85b229013 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:08.189909 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-767e7fe9-38ed-4fa7-8001-3bf85b229013 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1746 microversion: 2.20 time: 0.167522 Jul 18 17:01:08.190485 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 562/1132] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:08 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:08.191394 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dcd48fae-eca7-4e25-8612-ca28cd439313 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:08.192068 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dcd48fae-eca7-4e25-8612-ca28cd439313 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:08.192984 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dcd48fae-eca7-4e25-8612-ca28cd439313 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:08.200048 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dcd48fae-eca7-4e25-8612-ca28cd439313 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:08.343123 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dcd48fae-eca7-4e25-8612-ca28cd439313 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:08.350941 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dcd48fae-eca7-4e25-8612-ca28cd439313 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1567 microversion: 2.1 time: 0.172267 Jul 18 17:01:08.351561 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 571/1133] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:08 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:08.703529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-410debcb-5876-4564-a510-4a0e1378bb7e req-12d1cebf-2c3d-4f38-9629-5ef886018fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58499c89-21dc-4a75-9cae-b2cc7f7e90b9", "name": "network-vif-plugged", "status": "completed", "tag": "38df9321-fcab-4ab6-a5e8-5f70fc544990"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:08.714342 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-410debcb-5876-4564-a510-4a0e1378bb7e req-12d1cebf-2c3d-4f38-9629-5ef886018fb6 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:08.714879 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-410debcb-5876-4564-a510-4a0e1378bb7e req-12d1cebf-2c3d-4f38-9629-5ef886018fb6 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:08.729191 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-410debcb-5876-4564-a510-4a0e1378bb7e req-12d1cebf-2c3d-4f38-9629-5ef886018fb6 service nova] Creating event network-vif-plugged:38df9321-fcab-4ab6-a5e8-5f70fc544990 for instance 58499c89-21dc-4a75-9cae-b2cc7f7e90b9 on hv-cinder-83754 Jul 18 17:01:08.736239 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-410debcb-5876-4564-a510-4a0e1378bb7e req-12d1cebf-2c3d-4f38-9629-5ef886018fb6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037483 Jul 18 17:01:08.737287 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 563/1134] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:08.822537 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-794db399-1520-4234-8134-8c1c305a4771 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:08.823221 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-794db399-1520-4234-8134-8c1c305a4771 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:08.830677 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-794db399-1520-4234-8134-8c1c305a4771 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:08.837073 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-794db399-1520-4234-8134-8c1c305a4771 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:08.837073 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-794db399-1520-4234-8134-8c1c305a4771 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:08.837073 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-794db399-1520-4234-8134-8c1c305a4771 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:08.994335 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-794db399-1520-4234-8134-8c1c305a4771 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:09.003914 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-794db399-1520-4234-8134-8c1c305a4771 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.186646 Jul 18 17:01:09.004976 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 572/1135] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:08 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:09.212172 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e4c8bd84-77d4-4aa7-bbd3-fc9cc3ff8a2b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:09.213514 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e4c8bd84-77d4-4aa7-bbd3-fc9cc3ff8a2b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:09.223698 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e4c8bd84-77d4-4aa7-bbd3-fc9cc3ff8a2b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:09.224358 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e4c8bd84-77d4-4aa7-bbd3-fc9cc3ff8a2b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:09.225167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e4c8bd84-77d4-4aa7-bbd3-fc9cc3ff8a2b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:09.225613 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e4c8bd84-77d4-4aa7-bbd3-fc9cc3ff8a2b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:09.263514 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-54774833-f507-4462-8fdf-38603fcb59a5 req-9a2aee9c-7e5b-4c6d-92ee-409db2bcd8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d25fa4-9505-4471-a0be-e3a486297f2d", "name": "network-vif-deleted", "tag": "f3c39284-35e1-4778-990a-0024c4b94641"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:09.272510 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-54774833-f507-4462-8fdf-38603fcb59a5 req-9a2aee9c-7e5b-4c6d-92ee-409db2bcd8e3 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:09.273607 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-54774833-f507-4462-8fdf-38603fcb59a5 req-9a2aee9c-7e5b-4c6d-92ee-409db2bcd8e3 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:09.285489 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-54774833-f507-4462-8fdf-38603fcb59a5 req-9a2aee9c-7e5b-4c6d-92ee-409db2bcd8e3 service nova] Creating event network-vif-deleted:f3c39284-35e1-4778-990a-0024c4b94641 for instance 87d25fa4-9505-4471-a0be-e3a486297f2d on hv-cinder-83754 Jul 18 17:01:09.290476 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-54774833-f507-4462-8fdf-38603fcb59a5 req-9a2aee9c-7e5b-4c6d-92ee-409db2bcd8e3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031253 Jul 18 17:01:09.291082 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 573/1136] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:09.369388 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-85f4aa58-b706-4d85-869f-3acb3c1b92ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:09.369528 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e4c8bd84-77d4-4aa7-bbd3-fc9cc3ff8a2b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:09.370169 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-85f4aa58-b706-4d85-869f-3acb3c1b92ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:09.377317 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-85f4aa58-b706-4d85-869f-3acb3c1b92ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:09.382386 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-85f4aa58-b706-4d85-869f-3acb3c1b92ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:09.382510 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e4c8bd84-77d4-4aa7-bbd3-fc9cc3ff8a2b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:09.382625 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-85f4aa58-b706-4d85-869f-3acb3c1b92ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:09.382625 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-85f4aa58-b706-4d85-869f-3acb3c1b92ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:09.382825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e4c8bd84-77d4-4aa7-bbd3-fc9cc3ff8a2b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:09.382825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e4c8bd84-77d4-4aa7-bbd3-fc9cc3ff8a2b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1746 microversion: 2.20 time: 0.176370 Jul 18 17:01:09.382825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 564/1137] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:09 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:09.442308 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-85f4aa58-b706-4d85-869f-3acb3c1b92ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:09.444769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:09.451456 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-85f4aa58-b706-4d85-869f-3acb3c1b92ae tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1381 microversion: 2.1 time: 0.086483 Jul 18 17:01:09.452025 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 574/1138] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:09 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1381 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:10.021153 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-654b6ddd-16f6-42c2-8452-6267e64b4fc7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:10.021825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-654b6ddd-16f6-42c2-8452-6267e64b4fc7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:10.028234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-654b6ddd-16f6-42c2-8452-6267e64b4fc7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:10.028687 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-654b6ddd-16f6-42c2-8452-6267e64b4fc7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:10.029535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-654b6ddd-16f6-42c2-8452-6267e64b4fc7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:10.029945 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-654b6ddd-16f6-42c2-8452-6267e64b4fc7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:10.173083 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-654b6ddd-16f6-42c2-8452-6267e64b4fc7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:10.181099 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-654b6ddd-16f6-42c2-8452-6267e64b4fc7 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.163707 Jul 18 17:01:10.181718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 565/1139] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:10 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:10.399876 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d4443fff-b0c0-495d-b81f-5330d7e3d612 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:10.400428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d4443fff-b0c0-495d-b81f-5330d7e3d612 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:10.408364 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d4443fff-b0c0-495d-b81f-5330d7e3d612 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:10.408809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d4443fff-b0c0-495d-b81f-5330d7e3d612 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:10.409612 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d4443fff-b0c0-495d-b81f-5330d7e3d612 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:10.410305 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d4443fff-b0c0-495d-b81f-5330d7e3d612 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:10.474142 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-685e4ee4-d34d-4965-89dc-7d4c0c82303f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:10.475233 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-685e4ee4-d34d-4965-89dc-7d4c0c82303f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:10.495998 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-685e4ee4-d34d-4965-89dc-7d4c0c82303f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:10.497001 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-685e4ee4-d34d-4965-89dc-7d4c0c82303f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:10.508759 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-685e4ee4-d34d-4965-89dc-7d4c0c82303f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:10.523807 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-685e4ee4-d34d-4965-89dc-7d4c0c82303f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:10.612560 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d4443fff-b0c0-495d-b81f-5330d7e3d612 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:10.619398 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-685e4ee4-d34d-4965-89dc-7d4c0c82303f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:10.621386 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d4443fff-b0c0-495d-b81f-5330d7e3d612 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:10.623613 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d4443fff-b0c0-495d-b81f-5330d7e3d612 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:10.625079 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d4443fff-b0c0-495d-b81f-5330d7e3d612 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1746 microversion: 2.20 time: 0.229252 Jul 18 17:01:10.625656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 575/1140] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:10 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1746 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:10.644292 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-685e4ee4-d34d-4965-89dc-7d4c0c82303f tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1220 microversion: 2.1 time: 0.180207 Jul 18 17:01:10.645945 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 566/1141] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:10 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1220 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:10.752710 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-c206d889-8353-4641-a2d2-ac48fd128d2b req-e8697728-6931-444c-9f05-0ad17283debd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55db823-1c00-4ca0-bc6f-cd070459c5e9", "name": "network-vif-plugged", "status": "completed", "tag": "2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:10.760860 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c206d889-8353-4641-a2d2-ac48fd128d2b req-e8697728-6931-444c-9f05-0ad17283debd service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:10.761338 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c206d889-8353-4641-a2d2-ac48fd128d2b req-e8697728-6931-444c-9f05-0ad17283debd service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:10.773299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-c206d889-8353-4641-a2d2-ac48fd128d2b req-e8697728-6931-444c-9f05-0ad17283debd service nova] Creating event network-vif-plugged:2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662 for instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 on hv-cinder-83754 Jul 18 17:01:10.778296 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-c206d889-8353-4641-a2d2-ac48fd128d2b req-e8697728-6931-444c-9f05-0ad17283debd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029560 Jul 18 17:01:10.778918 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 576/1142] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:11.089488 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a54dca84-834d-4441-9185-7678364a4c57 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f807309-b044-4e3f-a065-7a09810e7e6f"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:11.090674 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a54dca84-834d-4441-9185-7678364a4c57 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:11.097394 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a54dca84-834d-4441-9185-7678364a4c57 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.097852 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a54dca84-834d-4441-9185-7678364a4c57 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.098617 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a54dca84-834d-4441-9185-7678364a4c57 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.099055 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a54dca84-834d-4441-9185-7678364a4c57 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.201999 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7cf04dfa-ca36-4178-8de7-0311f35cef08 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:11.203451 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7cf04dfa-ca36-4178-8de7-0311f35cef08 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:11.212025 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7cf04dfa-ca36-4178-8de7-0311f35cef08 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.212567 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7cf04dfa-ca36-4178-8de7-0311f35cef08 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.213390 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7cf04dfa-ca36-4178-8de7-0311f35cef08 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.213829 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7cf04dfa-ca36-4178-8de7-0311f35cef08 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.308649 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-a54dca84-834d-4441-9185-7678364a4c57 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Invalid volume: volume 0f807309-b044-4e3f-a065-7a09810e7e6f is already attached to instances: e8d0d7ca-fd48-4083-9569-18fb20c564a9 Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a54dca84-834d-4441-9185-7678364a4c57 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: POST /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments HTTP/1.1 Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 74 Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:01:11.310463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:01:11.313853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:01:11.313853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:01:11.313853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:01:11.313853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:01:11.313853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:01:11.313853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:01:11.313853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:01:11.313853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 17:01:11.313853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:01:11.313853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Jul 18 17:01:11.313853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {"volumeAttachment": {"volumeId": "0f807309-b044-4e3f-a065-7a09810e7e6f"}} Jul 18 17:01:11.313853 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Invalid volume: volume 0f807309-b044-4e3f-a065-7a09810e7e6f is already attached to instances: e8d0d7ca-fd48-4083-9569-18fb20c564a9 Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'server_id': 'e8d0d7ca-fd48-4083-9569-18fb20c564a9', 'body': {'volumeAttachment': {'volumeId': '0f807309-b044-4e3f-a065-7a09810e7e6f'}}} Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0f807309-b044-4e3f-a065-7a09810e7e6f is already attached to instances: e8d0d7ca-fd48-4083-9569-18fb20c564a9 Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:01:11.318436 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0f807309-b044-4e3f-a065-7a09810e7e6f is already attached to instances: e8d0d7ca-fd48-4083-9569-18fb20c564a9 Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:11.319991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:11.321501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:11.321501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:11.321501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:11.321501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0f807309-b044-4e3f-a065-7a09810e7e6f is already attached to instances: e8d0d7ca-fd48-4083-9569-18fb20c564a9 Jul 18 17:01:11.321501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:01:11.321501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a54dca84-834d-4441-9185-7678364a4c57 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 400 to user: Invalid volume: volume 0f807309-b044-4e3f-a065-7a09810e7e6f is already attached to instances: e8d0d7ca-fd48-4083-9569-18fb20c564a9 {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:11.321501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a54dca84-834d-4441-9185-7678364a4c57 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "POST /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.228372 Jul 18 17:01:11.321501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 567/1143] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 17:01:11 2022] POST /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments => generated 174 bytes in 230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 17:01:11.374885 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7cf04dfa-ca36-4178-8de7-0311f35cef08 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:11.383101 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7cf04dfa-ca36-4178-8de7-0311f35cef08 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.186545 Jul 18 17:01:11.383391 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 577/1144] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:11 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:11.386951 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6bad728e-b103-4852-bbbd-578dd1231b5f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:11.387453 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6bad728e-b103-4852-bbbd-578dd1231b5f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:11.394485 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6bad728e-b103-4852-bbbd-578dd1231b5f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.399549 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6bad728e-b103-4852-bbbd-578dd1231b5f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.399549 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6bad728e-b103-4852-bbbd-578dd1231b5f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.399549 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6bad728e-b103-4852-bbbd-578dd1231b5f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.480309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-6bad728e-b103-4852-bbbd-578dd1231b5f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lazy-loading 'services' on Instance uuid e8d0d7ca-fd48-4083-9569-18fb20c564a9 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:01:11.644660 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1317a13c-90e1-447c-a410-22bbff205a92 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:11.645424 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1317a13c-90e1-447c-a410-22bbff205a92 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:11.652201 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1317a13c-90e1-447c-a410-22bbff205a92 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.652647 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1317a13c-90e1-447c-a410-22bbff205a92 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.653467 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1317a13c-90e1-447c-a410-22bbff205a92 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.653980 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1317a13c-90e1-447c-a410-22bbff205a92 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.707010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6bad728e-b103-4852-bbbd-578dd1231b5f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments/0f807309-b044-4e3f-a065-7a09810e7e6f" status: 202 len: 0 microversion: 2.1 time: 0.323901 Jul 18 17:01:11.707537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 568/1145] 10.222.0.76 () {58 vars in 1415 bytes} [Mon Jul 18 17:01:11 2022] DELETE /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments/0f807309-b044-4e3f-a065-7a09810e7e6f => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:01:11.713778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d27f3a28-5c1a-491d-9103-4683bde35aea tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:11.714678 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d27f3a28-5c1a-491d-9103-4683bde35aea tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:11.722220 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d27f3a28-5c1a-491d-9103-4683bde35aea tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.723038 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d27f3a28-5c1a-491d-9103-4683bde35aea tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.723644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d27f3a28-5c1a-491d-9103-4683bde35aea tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.724085 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d27f3a28-5c1a-491d-9103-4683bde35aea tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.757726 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d27f3a28-5c1a-491d-9103-4683bde35aea tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.758179 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d27f3a28-5c1a-491d-9103-4683bde35aea tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.758645 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-d27f3a28-5c1a-491d-9103-4683bde35aea tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lazy-loading 'fault' on Instance uuid 87d25fa4-9505-4471-a0be-e3a486297f2d {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:01:11.792673 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1317a13c-90e1-447c-a410-22bbff205a92 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:11.801591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1317a13c-90e1-447c-a410-22bbff205a92 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:11.802162 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d27f3a28-5c1a-491d-9103-4683bde35aea tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:11.803125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1317a13c-90e1-447c-a410-22bbff205a92 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:11.804298 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1317a13c-90e1-447c-a410-22bbff205a92 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1746 microversion: 2.20 time: 0.163703 Jul 18 17:01:11.804854 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 578/1146] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:11 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:11.809607 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b38e459e-b0f7-46c4-a0cc-c4a57e87d526 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:11.823704 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d27f3a28-5c1a-491d-9103-4683bde35aea tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1225 microversion: 2.1 time: 0.100595 Jul 18 17:01:11.823872 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b38e459e-b0f7-46c4-a0cc-c4a57e87d526 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:11.823974 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 569/1147] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:11 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:11.824067 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b38e459e-b0f7-46c4-a0cc-c4a57e87d526 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.824067 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b38e459e-b0f7-46c4-a0cc-c4a57e87d526 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.824067 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b38e459e-b0f7-46c4-a0cc-c4a57e87d526 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.824067 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b38e459e-b0f7-46c4-a0cc-c4a57e87d526 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.848986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b38e459e-b0f7-46c4-a0cc-c4a57e87d526 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042932 Jul 18 17:01:11.849573 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 579/1148] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:11 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:12.399588 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-91695222-7669-479f-b4c0-7eaabe6b5034 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:12.400192 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-91695222-7669-479f-b4c0-7eaabe6b5034 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:12.406712 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-91695222-7669-479f-b4c0-7eaabe6b5034 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:12.407158 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-91695222-7669-479f-b4c0-7eaabe6b5034 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:12.407912 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-91695222-7669-479f-b4c0-7eaabe6b5034 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:12.408346 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-91695222-7669-479f-b4c0-7eaabe6b5034 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:12.547017 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-91695222-7669-479f-b4c0-7eaabe6b5034 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:12.554733 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-91695222-7669-479f-b4c0-7eaabe6b5034 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1266 microversion: 2.1 time: 0.158966 Jul 18 17:01:12.555328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 570/1149] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:12 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:12.823669 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-41cdedbc-02d2-440b-9184-14568babf5aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:12.824291 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-41cdedbc-02d2-440b-9184-14568babf5aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:12.831715 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41cdedbc-02d2-440b-9184-14568babf5aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:12.832164 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41cdedbc-02d2-440b-9184-14568babf5aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:12.832934 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41cdedbc-02d2-440b-9184-14568babf5aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:12.833413 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41cdedbc-02d2-440b-9184-14568babf5aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:12.839788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5045993f-d91e-4f17-8e39-866d3e4a92f8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:12.840404 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5045993f-d91e-4f17-8e39-866d3e4a92f8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:12.847305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5045993f-d91e-4f17-8e39-866d3e4a92f8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:12.847760 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5045993f-d91e-4f17-8e39-866d3e4a92f8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:12.848532 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5045993f-d91e-4f17-8e39-866d3e4a92f8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:12.848973 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5045993f-d91e-4f17-8e39-866d3e4a92f8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:12.881268 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5045993f-d91e-4f17-8e39-866d3e4a92f8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:12.881723 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5045993f-d91e-4f17-8e39-866d3e4a92f8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:12.882329 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-5045993f-d91e-4f17-8e39-866d3e4a92f8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lazy-loading 'fault' on Instance uuid 87d25fa4-9505-4471-a0be-e3a486297f2d {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:01:12.927077 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5045993f-d91e-4f17-8e39-866d3e4a92f8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:12.930627 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:12.935069 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5045993f-d91e-4f17-8e39-866d3e4a92f8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1225 microversion: 2.1 time: 0.099127 Jul 18 17:01:12.935705 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 571/1150] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:12 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:12.948416 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2faf8913-6e37-4b29-9ca0-d48ed08b7ed6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:12.948416 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2faf8913-6e37-4b29-9ca0-d48ed08b7ed6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:12.948416 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2faf8913-6e37-4b29-9ca0-d48ed08b7ed6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:12.948416 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2faf8913-6e37-4b29-9ca0-d48ed08b7ed6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:12.948826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2faf8913-6e37-4b29-9ca0-d48ed08b7ed6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:12.949295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2faf8913-6e37-4b29-9ca0-d48ed08b7ed6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:12.973691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-41cdedbc-02d2-440b-9184-14568babf5aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:12.981643 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-41cdedbc-02d2-440b-9184-14568babf5aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:12.983646 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-41cdedbc-02d2-440b-9184-14568babf5aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:12.983805 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2faf8913-6e37-4b29-9ca0-d48ed08b7ed6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046940 Jul 18 17:01:12.984447 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 572/1151] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:12 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:12.984828 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-41cdedbc-02d2-440b-9184-14568babf5aa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1746 microversion: 2.20 time: 0.165163 Jul 18 17:01:12.985486 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 580/1152] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:12 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:13.572831 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-71f36302-e5ed-42e2-ae9f-438a51e42345 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:13.573579 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-71f36302-e5ed-42e2-ae9f-438a51e42345 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:13.584886 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-71f36302-e5ed-42e2-ae9f-438a51e42345 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:13.584886 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-71f36302-e5ed-42e2-ae9f-438a51e42345 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:13.584886 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-71f36302-e5ed-42e2-ae9f-438a51e42345 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:13.584886 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-71f36302-e5ed-42e2-ae9f-438a51e42345 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:13.726454 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-71f36302-e5ed-42e2-ae9f-438a51e42345 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:13.735623 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-71f36302-e5ed-42e2-ae9f-438a51e42345 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1453 microversion: 2.1 time: 0.166890 Jul 18 17:01:13.745442 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 573/1153] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:13 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:13.752726 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8d863c30-3086-4de4-839a-74885f1ada16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:13.753370 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8d863c30-3086-4de4-839a-74885f1ada16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:13.755311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:13.760124 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d863c30-3086-4de4-839a-74885f1ada16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:13.760573 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d863c30-3086-4de4-839a-74885f1ada16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:13.761477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d863c30-3086-4de4-839a-74885f1ada16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:13.761918 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d863c30-3086-4de4-839a-74885f1ada16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:13.952226 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-48719a5e-c4fb-4a72-92da-c40af7a2769d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:13.952838 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-48719a5e-c4fb-4a72-92da-c40af7a2769d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:13.959125 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48719a5e-c4fb-4a72-92da-c40af7a2769d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:13.959582 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48719a5e-c4fb-4a72-92da-c40af7a2769d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:13.960358 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48719a5e-c4fb-4a72-92da-c40af7a2769d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:13.960798 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48719a5e-c4fb-4a72-92da-c40af7a2769d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:13.994439 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48719a5e-c4fb-4a72-92da-c40af7a2769d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:13.994900 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-48719a5e-c4fb-4a72-92da-c40af7a2769d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:13.995367 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-48719a5e-c4fb-4a72-92da-c40af7a2769d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lazy-loading 'fault' on Instance uuid 87d25fa4-9505-4471-a0be-e3a486297f2d {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:01:14.002805 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8d863c30-3086-4de4-839a-74885f1ada16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:14.011304 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8d863c30-3086-4de4-839a-74885f1ada16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1453 microversion: 2.1 time: 0.262583 Jul 18 17:01:14.012279 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 581/1154] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:13 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1453 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:14.018227 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bd54f4f0-851f-412f-91ff-6ba96eff9106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:14.019361 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bd54f4f0-851f-412f-91ff-6ba96eff9106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:14.027350 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bd54f4f0-851f-412f-91ff-6ba96eff9106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:14.033257 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bd54f4f0-851f-412f-91ff-6ba96eff9106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:14.033257 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bd54f4f0-851f-412f-91ff-6ba96eff9106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:14.033257 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bd54f4f0-851f-412f-91ff-6ba96eff9106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:14.044944 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-48719a5e-c4fb-4a72-92da-c40af7a2769d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011730621194d0e8165de381177bd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46abecf729dd426f9ffc02cee5d67150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:14.052920 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-48719a5e-c4fb-4a72-92da-c40af7a2769d tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 200 len: 1225 microversion: 2.1 time: 0.105062 Jul 18 17:01:14.053543 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 574/1155] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:13 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:14.058279 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-95284bb7-1d13-46df-927d-cb4376cb3c7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:14.058929 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-95284bb7-1d13-46df-927d-cb4376cb3c7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:14.065751 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95284bb7-1d13-46df-927d-cb4376cb3c7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:14.066212 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95284bb7-1d13-46df-927d-cb4376cb3c7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:14.066988 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95284bb7-1d13-46df-927d-cb4376cb3c7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:14.067435 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95284bb7-1d13-46df-927d-cb4376cb3c7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:14.067550 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bd54f4f0-851f-412f-91ff-6ba96eff9106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053772 Jul 18 17:01:14.068356 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 582/1156] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:14 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:14.229368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-95284bb7-1d13-46df-927d-cb4376cb3c7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:14.239535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-95284bb7-1d13-46df-927d-cb4376cb3c7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:14.241283 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-95284bb7-1d13-46df-927d-cb4376cb3c7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:14.242468 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-95284bb7-1d13-46df-927d-cb4376cb3c7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1746 microversion: 2.20 time: 0.188012 Jul 18 17:01:14.243030 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 575/1157] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:14 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1746 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:15.071549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0950b714-1ba4-4771-83a4-a251f1ee186c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:15.072185 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0950b714-1ba4-4771-83a4-a251f1ee186c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] [instance: 87d25fa4-9505-4471-a0be-e3a486297f2d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:15.081397 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0950b714-1ba4-4771-83a4-a251f1ee186c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.082337 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0950b714-1ba4-4771-83a4-a251f1ee186c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.083314 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0950b714-1ba4-4771-83a4-a251f1ee186c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.084276 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0950b714-1ba4-4771-83a4-a251f1ee186c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.085110 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-634663f1-5732-43f0-badc-85d9eea1ee6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:15.086604 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-634663f1-5732-43f0-badc-85d9eea1ee6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:15.096220 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-634663f1-5732-43f0-badc-85d9eea1ee6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.096849 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-634663f1-5732-43f0-badc-85d9eea1ee6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.097770 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-634663f1-5732-43f0-badc-85d9eea1ee6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.098425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-634663f1-5732-43f0-badc-85d9eea1ee6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.102108 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-0950b714-1ba4-4771-83a4-a251f1ee186c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] HTTP exception thrown: Instance 87d25fa4-9505-4471-a0be-e3a486297f2d could not be found. Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0950b714-1ba4-4771-83a4-a251f1ee186c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Request method failure captured: Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d HTTP/1.1 Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1ZApfkn-JeE9ExjxCfbipX9PJuc_kJLs5QnZ2GLZEms5JnJHI8fhrGA-BCJxiqj2OrN4Ai22Xz4cGSAuATTHzWizJargXTYyO0B6NBzJxNl-l_OjYgbMUJF-i1woTZ0VeZeda3IIqdJLhusXAfumlQW9aIOC6N511fQHcMkcKP-4hlo Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 46abecf729dd426f9ffc02cee5d67150 Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-TestShelveInstance-1176875363 Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 17:01:15.104208 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 17:01:15.105967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_46abecf729dd426f9ffc02cee5d67150"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/46abecf729dd426f9ffc02cee5d67150"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/46abecf729dd426f9ffc02cee5d67150"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/46abecf729dd426f9ffc02cee5d67150"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:01:15.105967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-TestShelveInstance-1176875363 Jul 18 17:01:15.105967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 46abecf729dd426f9ffc02cee5d67150 Jul 18 17:01:15.105967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-TestShelveInstance-1176875363 Jul 18 17:01:15.105967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-TestShelveInstance-1176875363-project Jul 18 17:01:15.105967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 17:01:15.105967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 17:01:15.105967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 9011730621194d0e8165de381177bd2e Jul 18 17:01:15.105967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-TestShelveInstance-1176875363-project Jul 18 17:01:15.105967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 17:01:15.105967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance 87d25fa4-9505-4471-a0be-e3a486297f2d could not be found. Jul 18 17:01:15.105967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '87d25fa4-9505-4471-a0be-e3a486297f2d'} Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d25fa4-9505-4471-a0be-e3a486297f2d could not be found. Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:15.106948 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d25fa4-9505-4471-a0be-e3a486297f2d could not be found. Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d25fa4-9505-4471-a0be-e3a486297f2d could not be found. Jul 18 17:01:15.108587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:01:15.111263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0950b714-1ba4-4771-83a4-a251f1ee186c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Returning 404 to user: Instance 87d25fa4-9505-4471-a0be-e3a486297f2d could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:15.112297 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0950b714-1ba4-4771-83a4-a251f1ee186c tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d" status: 404 len: 111 microversion: 2.1 time: 0.044923 Jul 18 17:01:15.113408 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 583/1158] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:15 2022] GET /compute/v2.1/servers/87d25fa4-9505-4471-a0be-e3a486297f2d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:01:15.146970 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-634663f1-5732-43f0-badc-85d9eea1ee6d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071422 Jul 18 17:01:15.148218 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 576/1159] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:15 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 17:01:15.245389 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9ae041b0-0b5c-4140-bbea-18741547a993 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:15.245909 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9ae041b0-0b5c-4140-bbea-18741547a993 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:15.256424 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ae041b0-0b5c-4140-bbea-18741547a993 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.262825 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e98ba031-fab1-471f-9b02-741bd0f97891 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:15.263775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e98ba031-fab1-471f-9b02-741bd0f97891 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:15.269425 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ae041b0-0b5c-4140-bbea-18741547a993 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.275399 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ae041b0-0b5c-4140-bbea-18741547a993 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.275399 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ae041b0-0b5c-4140-bbea-18741547a993 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.275789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e98ba031-fab1-471f-9b02-741bd0f97891 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.275789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e98ba031-fab1-471f-9b02-741bd0f97891 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.275789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e98ba031-fab1-471f-9b02-741bd0f97891 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.281073 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e98ba031-fab1-471f-9b02-741bd0f97891 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.314419 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9ae041b0-0b5c-4140-bbea-18741547a993 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:01:15.450181 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e98ba031-fab1-471f-9b02-741bd0f97891 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:15.459890 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e98ba031-fab1-471f-9b02-741bd0f97891 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:15.461463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e98ba031-fab1-471f-9b02-741bd0f97891 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:15.462634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e98ba031-fab1-471f-9b02-741bd0f97891 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1741 microversion: 2.20 time: 0.204053 Jul 18 17:01:15.463616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 577/1160] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:15 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:15.504558 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d9e0c1c9-38be-4efd-85f2-9ca13417abe8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] Calling method '.version_select at 0x7f4af1f3b700>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:15.541088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:15.594826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d9e0c1c9-38be-4efd-85f2-9ca13417abe8 tempest-TestShelveInstance-1176875363 tempest-TestShelveInstance-1176875363-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1556813197" status: 202 len: 0 microversion: 2.1 time: 0.093708 Jul 18 17:01:15.601473 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 578/1161] 10.222.0.76 () {58 vars in 1253 bytes} [Mon Jul 18 17:01:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1556813197 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:01:15.671626 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9ae041b0-0b5c-4140-bbea-18741547a993 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 204 len: 0 microversion: 2.1 time: 0.428912 Jul 18 17:01:15.672480 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 584/1162] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:01:15 2022] DELETE /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:01:15.681427 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e05caa29-572a-487d-9af5-5637e5fb1106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:15.682129 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e05caa29-572a-487d-9af5-5637e5fb1106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:15.692162 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e05caa29-572a-487d-9af5-5637e5fb1106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.692735 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e05caa29-572a-487d-9af5-5637e5fb1106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.693914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e05caa29-572a-487d-9af5-5637e5fb1106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.694806 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e05caa29-572a-487d-9af5-5637e5fb1106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.960244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e05caa29-572a-487d-9af5-5637e5fb1106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:15.973726 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e05caa29-572a-487d-9af5-5637e5fb1106 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1681 microversion: 2.1 time: 0.296920 Jul 18 17:01:15.976737 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 579/1163] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:15 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1681 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:16.486022 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b5199bf2-af20-44e4-918f-425327475d1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:16.486947 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b5199bf2-af20-44e4-918f-425327475d1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:16.498383 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b5199bf2-af20-44e4-918f-425327475d1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:16.499636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b5199bf2-af20-44e4-918f-425327475d1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:16.513106 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b5199bf2-af20-44e4-918f-425327475d1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:16.513807 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b5199bf2-af20-44e4-918f-425327475d1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:16.760390 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b5199bf2-af20-44e4-918f-425327475d1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:16.776805 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-47fb6ba7-c9c0-43dd-a2b9-13bb88c2fd38 req-51ae695d-e833-4e81-aba2-02a3d65c8fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58499c89-21dc-4a75-9cae-b2cc7f7e90b9", "tag": "38df9321-fcab-4ab6-a5e8-5f70fc544990"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:16.784620 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b5199bf2-af20-44e4-918f-425327475d1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:16.788199 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b5199bf2-af20-44e4-918f-425327475d1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:16.791703 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b5199bf2-af20-44e4-918f-425327475d1c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1741 microversion: 2.20 time: 0.311501 Jul 18 17:01:16.792693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-47fb6ba7-c9c0-43dd-a2b9-13bb88c2fd38 req-51ae695d-e833-4e81-aba2-02a3d65c8fe8 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:16.793486 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-47fb6ba7-c9c0-43dd-a2b9-13bb88c2fd38 req-51ae695d-e833-4e81-aba2-02a3d65c8fe8 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:16.793926 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 585/1164] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:16 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1741 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:16.820236 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-47fb6ba7-c9c0-43dd-a2b9-13bb88c2fd38 req-51ae695d-e833-4e81-aba2-02a3d65c8fe8 service nova] Creating event network-changed:38df9321-fcab-4ab6-a5e8-5f70fc544990 for instance 58499c89-21dc-4a75-9cae-b2cc7f7e90b9 on hv-cinder-83754 Jul 18 17:01:16.827182 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-47fb6ba7-c9c0-43dd-a2b9-13bb88c2fd38 req-51ae695d-e833-4e81-aba2-02a3d65c8fe8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059416 Jul 18 17:01:16.831868 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 580/1165] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:16.995442 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-95d702f1-a6bd-4024-8a20-235626ab45a6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:16.996502 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-95d702f1-a6bd-4024-8a20-235626ab45a6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:17.004718 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-95d702f1-a6bd-4024-8a20-235626ab45a6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:17.005205 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-95d702f1-a6bd-4024-8a20-235626ab45a6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:17.005998 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-95d702f1-a6bd-4024-8a20-235626ab45a6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:17.006440 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-95d702f1-a6bd-4024-8a20-235626ab45a6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:17.255855 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-95d702f1-a6bd-4024-8a20-235626ab45a6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:17.266349 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-95d702f1-a6bd-4024-8a20-235626ab45a6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1681 microversion: 2.1 time: 0.276431 Jul 18 17:01:17.294872 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 586/1166] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:16 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1681 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:17.814872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6172945e-5b2f-4d39-bc67-df85e8921951 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:17.815661 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6172945e-5b2f-4d39-bc67-df85e8921951 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:17.829708 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6172945e-5b2f-4d39-bc67-df85e8921951 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:17.830428 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6172945e-5b2f-4d39-bc67-df85e8921951 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:17.831448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6172945e-5b2f-4d39-bc67-df85e8921951 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:17.832076 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6172945e-5b2f-4d39-bc67-df85e8921951 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:18.223460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6172945e-5b2f-4d39-bc67-df85e8921951 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:18.231748 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6172945e-5b2f-4d39-bc67-df85e8921951 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:18.238558 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6172945e-5b2f-4d39-bc67-df85e8921951 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:18.240509 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6172945e-5b2f-4d39-bc67-df85e8921951 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1741 microversion: 2.20 time: 0.432487 Jul 18 17:01:18.252103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 581/1167] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:17 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1741 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:18.289610 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-87ccc929-5072-4630-9f0b-0ad36d316b55 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:18.290730 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-87ccc929-5072-4630-9f0b-0ad36d316b55 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:18.312382 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-87ccc929-5072-4630-9f0b-0ad36d316b55 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:18.313232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-87ccc929-5072-4630-9f0b-0ad36d316b55 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:18.314029 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-87ccc929-5072-4630-9f0b-0ad36d316b55 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:18.314637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-87ccc929-5072-4630-9f0b-0ad36d316b55 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:18.722809 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-87ccc929-5072-4630-9f0b-0ad36d316b55 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:18.739905 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-87ccc929-5072-4630-9f0b-0ad36d316b55 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1681 microversion: 2.1 time: 0.456694 Jul 18 17:01:18.750337 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 587/1168] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:18 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1681 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:19.271107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d6403a93-8bf2-4c81-b3f3-3b7c023a4a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:19.271819 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d6403a93-8bf2-4c81-b3f3-3b7c023a4a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:19.286781 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d6403a93-8bf2-4c81-b3f3-3b7c023a4a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:19.287239 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d6403a93-8bf2-4c81-b3f3-3b7c023a4a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:19.288028 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d6403a93-8bf2-4c81-b3f3-3b7c023a4a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:19.288471 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d6403a93-8bf2-4c81-b3f3-3b7c023a4a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:19.507900 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d6403a93-8bf2-4c81-b3f3-3b7c023a4a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:19.527730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d6403a93-8bf2-4c81-b3f3-3b7c023a4a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:19.537065 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d6403a93-8bf2-4c81-b3f3-3b7c023a4a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:19.539671 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d6403a93-8bf2-4c81-b3f3-3b7c023a4a23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1741 microversion: 2.20 time: 0.273359 Jul 18 17:01:19.543381 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 582/1169] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:19 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1741 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:19.759844 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-634444a0-1c9c-4937-9535-0cbf80743ecc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:19.760466 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-634444a0-1c9c-4937-9535-0cbf80743ecc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:19.768950 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-634444a0-1c9c-4937-9535-0cbf80743ecc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:19.769461 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-634444a0-1c9c-4937-9535-0cbf80743ecc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:19.774715 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-634444a0-1c9c-4937-9535-0cbf80743ecc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:19.777179 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-634444a0-1c9c-4937-9535-0cbf80743ecc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:19.889779 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-634444a0-1c9c-4937-9535-0cbf80743ecc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:19.898984 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-634444a0-1c9c-4937-9535-0cbf80743ecc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1613 microversion: 2.1 time: 0.142880 Jul 18 17:01:19.899578 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 588/1170] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:19 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1613 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:20.441245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-9c8ef71f-22f9-48bb-9df2-eb79764f8bbd req-9902d452-1093-45e0-85a5-77efb48fb739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d0d7ca-fd48-4083-9569-18fb20c564a9", "name": "network-vif-deleted", "tag": "3b49a420-2c47-4e76-aaed-02ecf0bb74aa"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:20.450099 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-9c8ef71f-22f9-48bb-9df2-eb79764f8bbd req-9902d452-1093-45e0-85a5-77efb48fb739 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:20.450549 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-9c8ef71f-22f9-48bb-9df2-eb79764f8bbd req-9902d452-1093-45e0-85a5-77efb48fb739 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:20.462745 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-9c8ef71f-22f9-48bb-9df2-eb79764f8bbd req-9902d452-1093-45e0-85a5-77efb48fb739 service nova] Creating event network-vif-deleted:3b49a420-2c47-4e76-aaed-02ecf0bb74aa for instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 on hv-cinder-83754 Jul 18 17:01:20.467783 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-9c8ef71f-22f9-48bb-9df2-eb79764f8bbd req-9902d452-1093-45e0-85a5-77efb48fb739 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031695 Jul 18 17:01:20.468401 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 583/1171] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:20.559950 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f4e1fe9a-3db4-4f6a-b61b-214190a0ee7b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:20.560639 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f4e1fe9a-3db4-4f6a-b61b-214190a0ee7b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:20.566564 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f4e1fe9a-3db4-4f6a-b61b-214190a0ee7b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:20.567017 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f4e1fe9a-3db4-4f6a-b61b-214190a0ee7b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:20.567800 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f4e1fe9a-3db4-4f6a-b61b-214190a0ee7b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:20.568243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f4e1fe9a-3db4-4f6a-b61b-214190a0ee7b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:20.908548 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f4e1fe9a-3db4-4f6a-b61b-214190a0ee7b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:20.916133 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0fa7728d-d41b-47eb-8dc0-4b555d732ccf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:20.916863 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0fa7728d-d41b-47eb-8dc0-4b555d732ccf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:20.939140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0fa7728d-d41b-47eb-8dc0-4b555d732ccf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:20.939627 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0fa7728d-d41b-47eb-8dc0-4b555d732ccf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:20.940451 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0fa7728d-d41b-47eb-8dc0-4b555d732ccf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:20.940912 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0fa7728d-d41b-47eb-8dc0-4b555d732ccf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:20.941521 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f4e1fe9a-3db4-4f6a-b61b-214190a0ee7b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:20.943223 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f4e1fe9a-3db4-4f6a-b61b-214190a0ee7b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:20.952057 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f4e1fe9a-3db4-4f6a-b61b-214190a0ee7b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1741 microversion: 2.20 time: 0.393363 Jul 18 17:01:20.961460 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 589/1172] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:20 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1741 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:21.019521 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0fa7728d-d41b-47eb-8dc0-4b555d732ccf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:21.019974 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0fa7728d-d41b-47eb-8dc0-4b555d732ccf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:21.020454 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-0fa7728d-d41b-47eb-8dc0-4b555d732ccf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lazy-loading 'fault' on Instance uuid e8d0d7ca-fd48-4083-9569-18fb20c564a9 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:01:21.082278 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0fa7728d-d41b-47eb-8dc0-4b555d732ccf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:21.091595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0fa7728d-d41b-47eb-8dc0-4b555d732ccf tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 200 len: 1330 microversion: 2.1 time: 0.179616 Jul 18 17:01:21.105709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 584/1173] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:20 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 1330 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:21.974146 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d6920892-1637-4526-9733-d8af24c1139e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:21.978109 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d6920892-1637-4526-9733-d8af24c1139e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:21.995623 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6920892-1637-4526-9733-d8af24c1139e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:21.996410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6920892-1637-4526-9733-d8af24c1139e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:22.002372 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6920892-1637-4526-9733-d8af24c1139e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:22.003486 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6920892-1637-4526-9733-d8af24c1139e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:22.112653 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-81c30c72-87e3-44a5-ba3b-1c33711545b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:22.113577 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-81c30c72-87e3-44a5-ba3b-1c33711545b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:22.132628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-81c30c72-87e3-44a5-ba3b-1c33711545b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:22.142311 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-81c30c72-87e3-44a5-ba3b-1c33711545b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:22.143383 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-81c30c72-87e3-44a5-ba3b-1c33711545b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:22.143914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-81c30c72-87e3-44a5-ba3b-1c33711545b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:22.183562 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-81c30c72-87e3-44a5-ba3b-1c33711545b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-81c30c72-87e3-44a5-ba3b-1c33711545b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 HTTP/1.1 Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:01:22.185728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:01:22.200006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:01:22.200006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:01:22.200006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:01:22.200006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:01:22.200006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:01:22.200006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:01:22.200006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:01:22.200006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 17:01:22.200006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:01:22.200006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:01:22.200006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:01:22.200006 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': 'e8d0d7ca-fd48-4083-9569-18fb20c564a9'} Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:22.201228 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:01:22.202797 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.216481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-81c30c72-87e3-44a5-ba3b-1c33711545b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 404 to user: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:22.216481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-81c30c72-87e3-44a5-ba3b-1c33711545b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 404 len: 111 microversion: 2.1 time: 0.090614 Jul 18 17:01:22.216481 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 585/1174] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:22 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:01:22.235168 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-802faf9d-e8f8-4297-9eb3-c74f3fec1742 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '.version_select at 0x7f4af1f59820>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:22.378328 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-802faf9d-e8f8-4297-9eb3-c74f3fec1742 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134818614" status: 202 len: 0 microversion: 2.1 time: 0.156627 Jul 18 17:01:22.380036 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 586/1175] 10.222.0.76 () {58 vars in 1217 bytes} [Mon Jul 18 17:01:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134818614 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:01:22.515470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d6920892-1637-4526-9733-d8af24c1139e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:22.536641 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d6920892-1637-4526-9733-d8af24c1139e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:22.546526 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d6920892-1637-4526-9733-d8af24c1139e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:22.546526 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d6920892-1637-4526-9733-d8af24c1139e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1741 microversion: 2.20 time: 0.576558 Jul 18 17:01:22.546526 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 590/1176] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:21 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1741 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:23.568861 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8b6c2d84-89b4-4c3e-88f3-303eee922822 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:23.569686 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8b6c2d84-89b4-4c3e-88f3-303eee922822 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:23.596293 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b6c2d84-89b4-4c3e-88f3-303eee922822 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:23.596747 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b6c2d84-89b4-4c3e-88f3-303eee922822 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:23.603820 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b6c2d84-89b4-4c3e-88f3-303eee922822 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:23.604728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b6c2d84-89b4-4c3e-88f3-303eee922822 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:23.945139 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8b6c2d84-89b4-4c3e-88f3-303eee922822 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:23.959067 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8b6c2d84-89b4-4c3e-88f3-303eee922822 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:23.961241 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8b6c2d84-89b4-4c3e-88f3-303eee922822 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:23.963702 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8b6c2d84-89b4-4c3e-88f3-303eee922822 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1741 microversion: 2.20 time: 0.400148 Jul 18 17:01:23.980922 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 587/1177] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:23 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1741 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:24.176013 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3531e605-be7d-4a24-ace8-51baa88a2976 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Action: 'create', calling method: .version_select at 0x7f4af16e0700>, body: {"keypair": {"name": "tempest-keypair-1575436049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcRzAevdXsdejrllAo854diPM76R1whB9iP2Wgs4SRARqsx+RIp+UyZc4IwEr6YGFHBrqrQkv+xnbdmpzDNNaLQislzeAkRQDm7XHGCgf38yi8ITxMfSlH8ovHrjLlYrg=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:24.195693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-3531e605-be7d-4a24-ace8-51baa88a2976 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for project 4f82344d2255427582cc29e253b37f0b. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:01:24.205764 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-3531e605-be7d-4a24-ace8-51baa88a2976 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for user 0cf277a2d03443c8af7a7bee2731d9d1 and project 4f82344d2255427582cc29e253b37f0b. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:01:24.311342 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3531e605-be7d-4a24-ace8-51baa88a2976 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141170 Jul 18 17:01:24.313492 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 591/1178] 10.222.0.76 () {60 vars in 1158 bytes} [Mon Jul 18 17:01:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:25.013296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f1f74b98-cc64-478a-ba8d-2ee0aa76af68 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:25.014732 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f1f74b98-cc64-478a-ba8d-2ee0aa76af68 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:25.022218 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1f74b98-cc64-478a-ba8d-2ee0aa76af68 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:25.022679 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1f74b98-cc64-478a-ba8d-2ee0aa76af68 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:25.023488 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1f74b98-cc64-478a-ba8d-2ee0aa76af68 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:25.023934 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1f74b98-cc64-478a-ba8d-2ee0aa76af68 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:25.183669 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f1f74b98-cc64-478a-ba8d-2ee0aa76af68 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:25.194545 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f1f74b98-cc64-478a-ba8d-2ee0aa76af68 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:25.196656 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f1f74b98-cc64-478a-ba8d-2ee0aa76af68 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:25.198284 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f1f74b98-cc64-478a-ba8d-2ee0aa76af68 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1741 microversion: 2.20 time: 0.189332 Jul 18 17:01:25.205632 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 588/1179] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:25 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:26.224817 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-98943eae-9937-4b45-a3a1-996705c8a184 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:26.245741 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-98943eae-9937-4b45-a3a1-996705c8a184 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:26.245741 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98943eae-9937-4b45-a3a1-996705c8a184 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:26.245741 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98943eae-9937-4b45-a3a1-996705c8a184 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:26.245741 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98943eae-9937-4b45-a3a1-996705c8a184 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:26.246873 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98943eae-9937-4b45-a3a1-996705c8a184 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:26.294674 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:26.475668 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-98943eae-9937-4b45-a3a1-996705c8a184 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:26.484930 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-98943eae-9937-4b45-a3a1-996705c8a184 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:26.487103 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-98943eae-9937-4b45-a3a1-996705c8a184 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:26.488859 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-98943eae-9937-4b45-a3a1-996705c8a184 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1741 microversion: 2.20 time: 0.268947 Jul 18 17:01:26.490075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 592/1180] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:26 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1741 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:27.804998 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-880890a1-6d25-4f4d-968a-e23dce982183 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:27.805614 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-880890a1-6d25-4f4d-968a-e23dce982183 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:27.817220 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-880890a1-6d25-4f4d-968a-e23dce982183 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:27.822385 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-880890a1-6d25-4f4d-968a-e23dce982183 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:27.825812 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-880890a1-6d25-4f4d-968a-e23dce982183 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:27.828136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-880890a1-6d25-4f4d-968a-e23dce982183 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:28.040216 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-880890a1-6d25-4f4d-968a-e23dce982183 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:28.064943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-880890a1-6d25-4f4d-968a-e23dce982183 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:28.068044 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-880890a1-6d25-4f4d-968a-e23dce982183 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:28.071850 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-880890a1-6d25-4f4d-968a-e23dce982183 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1741 microversion: 2.20 time: 0.565535 Jul 18 17:01:28.085362 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 589/1181] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:27 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1741 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:28.192300 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1242955047", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae3a9cc1-1c89-413a-9dc0-c337425ad213"}], "security_groups": [{"name": "tempest-securitygroup--858025663"}], "key_name": "tempest-keypair-1575436049", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:28.358650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] validate_networks() for [('ae3a9cc1-1c89-413a-9dc0-c337425ad213', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:01:28.885838 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:01:28.886300 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:01:28.886954 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:01:28.887513 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:01:28.889614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:01:28.915145 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:28.922151 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:28.926761 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:28.929254 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:28.993822 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for project 4f82344d2255427582cc29e253b37f0b. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:01:29.001903 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Getting quotas for user 0cf277a2d03443c8af7a7bee2731d9d1 and project 4f82344d2255427582cc29e253b37f0b. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:01:29.024692 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:01:29.028367 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:01:29.094310 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-46d1ef1d-0972-4b5e-bd06-eac37ed00c19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:29.129856 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-46d1ef1d-0972-4b5e-bd06-eac37ed00c19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:29.129856 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46d1ef1d-0972-4b5e-bd06-eac37ed00c19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:29.129856 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46d1ef1d-0972-4b5e-bd06-eac37ed00c19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:29.129856 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46d1ef1d-0972-4b5e-bd06-eac37ed00c19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:29.130479 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46d1ef1d-0972-4b5e-bd06-eac37ed00c19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:29.257653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a0452629-27a8-41a2-aecd-02e97527b3ef tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.079195 Jul 18 17:01:29.259326 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 593/1182] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 17:01:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 17:01:29.274559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-27677585-9618-43b3-bd0f-8b2ca79f1e68 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:29.276825 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-27677585-9618-43b3-bd0f-8b2ca79f1e68 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:29.358464 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-46d1ef1d-0972-4b5e-bd06-eac37ed00c19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:29.367689 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-46d1ef1d-0972-4b5e-bd06-eac37ed00c19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:29.369234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-46d1ef1d-0972-4b5e-bd06-eac37ed00c19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:29.370475 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-46d1ef1d-0972-4b5e-bd06-eac37ed00c19 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1741 microversion: 2.20 time: 0.282364 Jul 18 17:01:29.371056 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 590/1183] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:29 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1741 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:29.377842 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-27677585-9618-43b3-bd0f-8b2ca79f1e68 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:29.387558 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-27677585-9618-43b3-bd0f-8b2ca79f1e68 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1242 microversion: 2.1 time: 0.120374 Jul 18 17:01:29.388128 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 594/1184] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:29 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:30.389887 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-62cfedef-de46-4352-a57b-f7be3b6a2505 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:30.391260 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-62cfedef-de46-4352-a57b-f7be3b6a2505 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:30.408632 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-22175feb-7c1d-404b-b12c-4bbf0f6e0f02 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:30.409314 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-22175feb-7c1d-404b-b12c-4bbf0f6e0f02 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:30.418720 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-62cfedef-de46-4352-a57b-f7be3b6a2505 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:30.419522 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-62cfedef-de46-4352-a57b-f7be3b6a2505 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:30.421105 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-62cfedef-de46-4352-a57b-f7be3b6a2505 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:30.421920 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-62cfedef-de46-4352-a57b-f7be3b6a2505 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:30.516870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-22175feb-7c1d-404b-b12c-4bbf0f6e0f02 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:30.541240 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-22175feb-7c1d-404b-b12c-4bbf0f6e0f02 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1242 microversion: 2.1 time: 0.130471 Jul 18 17:01:30.542213 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 595/1185] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:30 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:30.641054 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-62cfedef-de46-4352-a57b-f7be3b6a2505 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:30.645428 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:30.650671 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-62cfedef-de46-4352-a57b-f7be3b6a2505 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:30.652370 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-62cfedef-de46-4352-a57b-f7be3b6a2505 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:30.653609 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-62cfedef-de46-4352-a57b-f7be3b6a2505 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1741 microversion: 2.20 time: 0.268372 Jul 18 17:01:30.654477 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 591/1186] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:30 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1741 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:31.561631 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b883cc75-a1d8-44c2-a73c-7bd805d50c8c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:31.562374 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b883cc75-a1d8-44c2-a73c-7bd805d50c8c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:31.580917 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b883cc75-a1d8-44c2-a73c-7bd805d50c8c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:31.581518 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b883cc75-a1d8-44c2-a73c-7bd805d50c8c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:31.582629 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b883cc75-a1d8-44c2-a73c-7bd805d50c8c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:31.583414 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b883cc75-a1d8-44c2-a73c-7bd805d50c8c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:31.650802 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b883cc75-a1d8-44c2-a73c-7bd805d50c8c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:31.659009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b883cc75-a1d8-44c2-a73c-7bd805d50c8c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1294 microversion: 2.1 time: 0.103084 Jul 18 17:01:31.659632 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 596/1187] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:31 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:31.673052 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3905208d-ffc0-4e97-bfc5-58d896f4b4db tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:31.673657 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3905208d-ffc0-4e97-bfc5-58d896f4b4db tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:31.680274 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3905208d-ffc0-4e97-bfc5-58d896f4b4db tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:31.680732 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3905208d-ffc0-4e97-bfc5-58d896f4b4db tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:31.681609 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3905208d-ffc0-4e97-bfc5-58d896f4b4db tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:31.682046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3905208d-ffc0-4e97-bfc5-58d896f4b4db tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:31.823140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3905208d-ffc0-4e97-bfc5-58d896f4b4db tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:31.831776 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3905208d-ffc0-4e97-bfc5-58d896f4b4db tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:31.833332 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3905208d-ffc0-4e97-bfc5-58d896f4b4db tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:31.834499 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3905208d-ffc0-4e97-bfc5-58d896f4b4db tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1741 microversion: 2.20 time: 0.166762 Jul 18 17:01:31.835119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 592/1188] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:31 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:32.676531 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2fe23809-12ab-4653-9c73-b66909818a9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:32.677167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2fe23809-12ab-4653-9c73-b66909818a9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:32.683828 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2fe23809-12ab-4653-9c73-b66909818a9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:32.684284 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2fe23809-12ab-4653-9c73-b66909818a9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:32.685098 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2fe23809-12ab-4653-9c73-b66909818a9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:32.686128 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2fe23809-12ab-4653-9c73-b66909818a9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:32.788394 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2fe23809-12ab-4653-9c73-b66909818a9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:32.806680 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2fe23809-12ab-4653-9c73-b66909818a9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1302 microversion: 2.1 time: 0.133983 Jul 18 17:01:32.814190 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 597/1189] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:32 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1302 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:32.854347 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-977134f6-0268-4552-9132-03b3b198a610 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:32.855394 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-977134f6-0268-4552-9132-03b3b198a610 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:32.862222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-977134f6-0268-4552-9132-03b3b198a610 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:32.862672 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-977134f6-0268-4552-9132-03b3b198a610 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:32.863439 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-977134f6-0268-4552-9132-03b3b198a610 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:32.863874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-977134f6-0268-4552-9132-03b3b198a610 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:33.095415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-977134f6-0268-4552-9132-03b3b198a610 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:33.103983 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-977134f6-0268-4552-9132-03b3b198a610 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:33.105509 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-977134f6-0268-4552-9132-03b3b198a610 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:33.106687 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-977134f6-0268-4552-9132-03b3b198a610 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1723 microversion: 2.20 time: 0.256858 Jul 18 17:01:33.109043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 593/1190] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:32 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:33.825554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4ab755c6-b35c-40fe-b67d-850e5676616b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:33.826938 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4ab755c6-b35c-40fe-b67d-850e5676616b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:33.834808 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4ab755c6-b35c-40fe-b67d-850e5676616b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:33.835273 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4ab755c6-b35c-40fe-b67d-850e5676616b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:33.836066 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4ab755c6-b35c-40fe-b67d-850e5676616b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:33.836510 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4ab755c6-b35c-40fe-b67d-850e5676616b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:33.970603 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4ab755c6-b35c-40fe-b67d-850e5676616b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:33.980130 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4ab755c6-b35c-40fe-b67d-850e5676616b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.158880 Jul 18 17:01:33.981472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 598/1191] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:33 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:34.131368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0380ee0d-164e-4fc2-a5c5-f74aebdb1d7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:34.131989 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0380ee0d-164e-4fc2-a5c5-f74aebdb1d7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:34.139340 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0380ee0d-164e-4fc2-a5c5-f74aebdb1d7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.143068 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0380ee0d-164e-4fc2-a5c5-f74aebdb1d7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.143068 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0380ee0d-164e-4fc2-a5c5-f74aebdb1d7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.143068 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0380ee0d-164e-4fc2-a5c5-f74aebdb1d7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.272202 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-30908b6d-c320-4e92-a144-a675b89d6399 req-44f92d39-9cff-4167-a7fa-ad028a0fcc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55db823-1c00-4ca0-bc6f-cd070459c5e9", "name": "network-vif-unplugged", "status": "completed", "tag": "2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:34.279125 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0380ee0d-164e-4fc2-a5c5-f74aebdb1d7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:34.281103 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-30908b6d-c320-4e92-a144-a675b89d6399 req-44f92d39-9cff-4167-a7fa-ad028a0fcc0b service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.281560 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-30908b6d-c320-4e92-a144-a675b89d6399 req-44f92d39-9cff-4167-a7fa-ad028a0fcc0b service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.287867 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0380ee0d-164e-4fc2-a5c5-f74aebdb1d7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:34.289448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0380ee0d-164e-4fc2-a5c5-f74aebdb1d7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:34.290815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0380ee0d-164e-4fc2-a5c5-f74aebdb1d7d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1723 microversion: 2.20 time: 0.163445 Jul 18 17:01:34.291374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 594/1192] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:34 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:34.292599 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-30908b6d-c320-4e92-a144-a675b89d6399 req-44f92d39-9cff-4167-a7fa-ad028a0fcc0b service nova] Creating event network-vif-unplugged:2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662 for instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 on hv-cinder-83754 Jul 18 17:01:34.297846 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-30908b6d-c320-4e92-a144-a675b89d6399 req-44f92d39-9cff-4167-a7fa-ad028a0fcc0b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030005 Jul 18 17:01:34.298437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 599/1193] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:35.006625 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f88142cb-6d1f-4d0a-a3e0-c541e1dbd0ca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:35.007163 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f88142cb-6d1f-4d0a-a3e0-c541e1dbd0ca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:35.013809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f88142cb-6d1f-4d0a-a3e0-c541e1dbd0ca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:35.014365 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f88142cb-6d1f-4d0a-a3e0-c541e1dbd0ca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:35.015189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f88142cb-6d1f-4d0a-a3e0-c541e1dbd0ca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:35.015635 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f88142cb-6d1f-4d0a-a3e0-c541e1dbd0ca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:35.167202 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f88142cb-6d1f-4d0a-a3e0-c541e1dbd0ca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:35.181925 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f88142cb-6d1f-4d0a-a3e0-c541e1dbd0ca tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.174783 Jul 18 17:01:35.181925 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 595/1194] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:35 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:35.311569 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-41faa8be-d7ae-435c-b995-b8a34459c9ba tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:35.312616 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-41faa8be-d7ae-435c-b995-b8a34459c9ba tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:35.323919 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41faa8be-d7ae-435c-b995-b8a34459c9ba tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:35.324451 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41faa8be-d7ae-435c-b995-b8a34459c9ba tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:35.329113 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41faa8be-d7ae-435c-b995-b8a34459c9ba tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:35.329602 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41faa8be-d7ae-435c-b995-b8a34459c9ba tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:35.581038 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-41faa8be-d7ae-435c-b995-b8a34459c9ba tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:35.590055 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-41faa8be-d7ae-435c-b995-b8a34459c9ba tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:35.592245 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-41faa8be-d7ae-435c-b995-b8a34459c9ba tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:35.593557 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-41faa8be-d7ae-435c-b995-b8a34459c9ba tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1723 microversion: 2.20 time: 0.287753 Jul 18 17:01:35.594346 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 600/1195] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:35 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:36.181556 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-efcf1634-10e3-45e8-8337-a4c947fb2e19 req-d01be5b0-0c08-49ba-b8e8-2cdf2084fcac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f024cc-89d3-458a-9095-be12de8d51ee", "tag": "be58750b-20bf-4709-a370-f4aa2631f5f9"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:36.195370 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9ba97103-b79a-45fc-8795-b96d7c78b0e7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:36.196279 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9ba97103-b79a-45fc-8795-b96d7c78b0e7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:36.199119 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-efcf1634-10e3-45e8-8337-a4c947fb2e19 req-d01be5b0-0c08-49ba-b8e8-2cdf2084fcac service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:36.200275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-efcf1634-10e3-45e8-8337-a4c947fb2e19 req-d01be5b0-0c08-49ba-b8e8-2cdf2084fcac service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:36.202912 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ba97103-b79a-45fc-8795-b96d7c78b0e7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:36.203689 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ba97103-b79a-45fc-8795-b96d7c78b0e7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:36.204677 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ba97103-b79a-45fc-8795-b96d7c78b0e7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:36.205310 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ba97103-b79a-45fc-8795-b96d7c78b0e7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:36.213846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-efcf1634-10e3-45e8-8337-a4c947fb2e19 req-d01be5b0-0c08-49ba-b8e8-2cdf2084fcac service nova] Creating event network-changed:be58750b-20bf-4709-a370-f4aa2631f5f9 for instance 79f024cc-89d3-458a-9095-be12de8d51ee on hv-cinder-83754 Jul 18 17:01:36.219046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-efcf1634-10e3-45e8-8337-a4c947fb2e19 req-d01be5b0-0c08-49ba-b8e8-2cdf2084fcac service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049893 Jul 18 17:01:36.219995 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 596/1196] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:36.354553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9ba97103-b79a-45fc-8795-b96d7c78b0e7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:36.363167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9ba97103-b79a-45fc-8795-b96d7c78b0e7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.171628 Jul 18 17:01:36.363920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 601/1197] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:36 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:36.613752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6004cb51-5d10-4da9-af13-7cc676abc22d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:36.613752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6004cb51-5d10-4da9-af13-7cc676abc22d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:36.624502 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6004cb51-5d10-4da9-af13-7cc676abc22d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:36.625034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6004cb51-5d10-4da9-af13-7cc676abc22d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:36.631249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6004cb51-5d10-4da9-af13-7cc676abc22d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:36.631249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6004cb51-5d10-4da9-af13-7cc676abc22d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:36.795397 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6004cb51-5d10-4da9-af13-7cc676abc22d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:36.805449 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6004cb51-5d10-4da9-af13-7cc676abc22d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:36.806971 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6004cb51-5d10-4da9-af13-7cc676abc22d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:36.808234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6004cb51-5d10-4da9-af13-7cc676abc22d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1726 microversion: 2.20 time: 0.199790 Jul 18 17:01:36.809614 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 597/1198] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:36 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1726 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:36.830215 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-17e246f3-3922-46ec-8a26-f118af946ce3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42d559c5-e604-43df-a53e-882112251805"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:36.831824 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-17e246f3-3922-46ec-8a26-f118af946ce3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:36.838341 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17e246f3-3922-46ec-8a26-f118af946ce3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:36.838790 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17e246f3-3922-46ec-8a26-f118af946ce3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:36.839574 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17e246f3-3922-46ec-8a26-f118af946ce3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:36.840022 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17e246f3-3922-46ec-8a26-f118af946ce3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:37.380501 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c12e3297-bade-4936-9068-68c14cb8e2f3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:37.381199 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c12e3297-bade-4936-9068-68c14cb8e2f3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:37.389187 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c12e3297-bade-4936-9068-68c14cb8e2f3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:37.389750 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c12e3297-bade-4936-9068-68c14cb8e2f3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:37.390619 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c12e3297-bade-4936-9068-68c14cb8e2f3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:37.391051 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c12e3297-bade-4936-9068-68c14cb8e2f3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:37.557488 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c12e3297-bade-4936-9068-68c14cb8e2f3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:37.568611 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c12e3297-bade-4936-9068-68c14cb8e2f3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.191960 Jul 18 17:01:37.569240 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 598/1199] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:37 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:37.926155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-17e246f3-3922-46ec-8a26-f118af946ce3 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "POST /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.102113 Jul 18 17:01:37.926793 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 602/1200] 10.222.0.76 () {62 vars in 1363 bytes} [Mon Jul 18 17:01:36 2022] POST /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/os-volume_attachments => generated 188 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 17:01:38.052645 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-637ea74a-ff82-4ed2-9d6d-25efca5ec909 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:38.053180 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-637ea74a-ff82-4ed2-9d6d-25efca5ec909 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:38.059633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-637ea74a-ff82-4ed2-9d6d-25efca5ec909 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.060628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-637ea74a-ff82-4ed2-9d6d-25efca5ec909 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.061440 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-637ea74a-ff82-4ed2-9d6d-25efca5ec909 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.061877 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-637ea74a-ff82-4ed2-9d6d-25efca5ec909 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.586124 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-936249ac-09a3-49d1-b453-326897c1cdac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:38.586729 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-936249ac-09a3-49d1-b453-326897c1cdac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:38.594367 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-936249ac-09a3-49d1-b453-326897c1cdac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.594823 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-936249ac-09a3-49d1-b453-326897c1cdac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.595612 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-936249ac-09a3-49d1-b453-326897c1cdac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.596071 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-936249ac-09a3-49d1-b453-326897c1cdac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.737367 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-936249ac-09a3-49d1-b453-326897c1cdac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:38.745281 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-936249ac-09a3-49d1-b453-326897c1cdac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.163200 Jul 18 17:01:38.745858 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 603/1201] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:38 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:38.748591 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-637ea74a-ff82-4ed2-9d6d-25efca5ec909 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/os-volume_attachments/42d559c5-e604-43df-a53e-882112251805" status: 202 len: 0 microversion: 2.20 time: 0.699904 Jul 18 17:01:38.749273 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 599/1202] 10.222.0.76 () {60 vars in 1456 bytes} [Mon Jul 18 17:01:38 2022] DELETE /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/os-volume_attachments/42d559c5-e604-43df-a53e-882112251805 => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:01:38.807480 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1b8cead5-97d7-4baa-b80a-98e7389d8c82 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:38.808056 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1b8cead5-97d7-4baa-b80a-98e7389d8c82 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:38.814976 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1b8cead5-97d7-4baa-b80a-98e7389d8c82 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.815420 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1b8cead5-97d7-4baa-b80a-98e7389d8c82 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.816201 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1b8cead5-97d7-4baa-b80a-98e7389d8c82 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.816636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1b8cead5-97d7-4baa-b80a-98e7389d8c82 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.967015 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:39.066772 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1b8cead5-97d7-4baa-b80a-98e7389d8c82 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "POST /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/action" status: 202 len: 0 microversion: 2.20 time: 0.263211 Jul 18 17:01:39.067672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 604/1203] 10.222.0.76 () {62 vars in 1318 bytes} [Mon Jul 18 17:01:38 2022] POST /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:01:39.080630 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-73a64d30-7bf7-41ea-b126-965414294c40 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:39.081401 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-73a64d30-7bf7-41ea-b126-965414294c40 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:39.089490 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-73a64d30-7bf7-41ea-b126-965414294c40 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:39.090348 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-73a64d30-7bf7-41ea-b126-965414294c40 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:39.091187 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-73a64d30-7bf7-41ea-b126-965414294c40 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:39.092126 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-73a64d30-7bf7-41ea-b126-965414294c40 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:39.244544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-73a64d30-7bf7-41ea-b126-965414294c40 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:39.253929 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-73a64d30-7bf7-41ea-b126-965414294c40 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:39.255455 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-73a64d30-7bf7-41ea-b126-965414294c40 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:39.256653 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-73a64d30-7bf7-41ea-b126-965414294c40 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1674 microversion: 2.20 time: 0.181301 Jul 18 17:01:39.257270 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 600/1204] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:39 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:39.764524 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f44b1f44-a0d5-44b4-be19-a7baae03693e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:39.765180 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f44b1f44-a0d5-44b4-be19-a7baae03693e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:39.771700 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f44b1f44-a0d5-44b4-be19-a7baae03693e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:39.772231 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f44b1f44-a0d5-44b4-be19-a7baae03693e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:39.773038 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f44b1f44-a0d5-44b4-be19-a7baae03693e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:39.773488 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f44b1f44-a0d5-44b4-be19-a7baae03693e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:39.956523 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f44b1f44-a0d5-44b4-be19-a7baae03693e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:39.964172 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f44b1f44-a0d5-44b4-be19-a7baae03693e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.204412 Jul 18 17:01:39.964742 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 605/1205] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:39 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:40.275678 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8862563e-9da2-4440-8238-8c8a143cbd6b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:40.276353 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8862563e-9da2-4440-8238-8c8a143cbd6b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:40.283869 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8862563e-9da2-4440-8238-8c8a143cbd6b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:40.284322 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8862563e-9da2-4440-8238-8c8a143cbd6b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:40.285113 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8862563e-9da2-4440-8238-8c8a143cbd6b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:40.286163 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8862563e-9da2-4440-8238-8c8a143cbd6b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:40.427405 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8862563e-9da2-4440-8238-8c8a143cbd6b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:40.435629 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8862563e-9da2-4440-8238-8c8a143cbd6b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:40.437151 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8862563e-9da2-4440-8238-8c8a143cbd6b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:40.438352 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8862563e-9da2-4440-8238-8c8a143cbd6b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1674 microversion: 2.20 time: 0.166671 Jul 18 17:01:40.438907 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 601/1206] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:40 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:40.981982 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-878f3f68-1a11-4f1d-9e8d-11329a3d56af tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:40.982656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-878f3f68-1a11-4f1d-9e8d-11329a3d56af tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:40.984438 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=14 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:40.990146 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-878f3f68-1a11-4f1d-9e8d-11329a3d56af tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:40.990603 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-878f3f68-1a11-4f1d-9e8d-11329a3d56af tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:40.991369 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-878f3f68-1a11-4f1d-9e8d-11329a3d56af tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:40.991856 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-878f3f68-1a11-4f1d-9e8d-11329a3d56af tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:41.133873 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-878f3f68-1a11-4f1d-9e8d-11329a3d56af tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:41.142325 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-878f3f68-1a11-4f1d-9e8d-11329a3d56af tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.164271 Jul 18 17:01:41.142924 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 606/1207] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:40 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:41.456422 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-680519d9-eb7d-4bc7-9932-31a84b7f60b5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:41.457315 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-680519d9-eb7d-4bc7-9932-31a84b7f60b5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:41.463635 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-680519d9-eb7d-4bc7-9932-31a84b7f60b5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:41.464088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-680519d9-eb7d-4bc7-9932-31a84b7f60b5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:41.467062 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-680519d9-eb7d-4bc7-9932-31a84b7f60b5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:41.467062 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-680519d9-eb7d-4bc7-9932-31a84b7f60b5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:41.612189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-680519d9-eb7d-4bc7-9932-31a84b7f60b5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:41.620133 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-680519d9-eb7d-4bc7-9932-31a84b7f60b5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:41.621720 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-680519d9-eb7d-4bc7-9932-31a84b7f60b5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:41.622894 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-680519d9-eb7d-4bc7-9932-31a84b7f60b5 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1676 microversion: 2.20 time: 0.170450 Jul 18 17:01:41.623443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 602/1208] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:41 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:42.159475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-44504a98-abea-4a09-a0cd-91c6c81fde54 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:42.160919 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-44504a98-abea-4a09-a0cd-91c6c81fde54 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:42.168070 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44504a98-abea-4a09-a0cd-91c6c81fde54 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:42.168521 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44504a98-abea-4a09-a0cd-91c6c81fde54 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:42.170127 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44504a98-abea-4a09-a0cd-91c6c81fde54 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:42.175427 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44504a98-abea-4a09-a0cd-91c6c81fde54 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:42.418488 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-44504a98-abea-4a09-a0cd-91c6c81fde54 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:42.430286 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-44504a98-abea-4a09-a0cd-91c6c81fde54 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.274596 Jul 18 17:01:42.430847 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 607/1209] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:42 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:42.642159 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8829f550-9d26-48bb-9d86-d25fa25978ef tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:42.642874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8829f550-9d26-48bb-9d86-d25fa25978ef tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:42.649658 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8829f550-9d26-48bb-9d86-d25fa25978ef tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:42.650123 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8829f550-9d26-48bb-9d86-d25fa25978ef tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:42.651498 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8829f550-9d26-48bb-9d86-d25fa25978ef tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:42.651946 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8829f550-9d26-48bb-9d86-d25fa25978ef tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:42.791342 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8829f550-9d26-48bb-9d86-d25fa25978ef tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:42.800224 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8829f550-9d26-48bb-9d86-d25fa25978ef tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:42.801761 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8829f550-9d26-48bb-9d86-d25fa25978ef tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:42.802978 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8829f550-9d26-48bb-9d86-d25fa25978ef tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.164888 Jul 18 17:01:42.803543 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 603/1210] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:42 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:43.447986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-12d002cf-1313-428b-9c5e-89742506d0b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:43.448925 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-12d002cf-1313-428b-9c5e-89742506d0b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:43.456116 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12d002cf-1313-428b-9c5e-89742506d0b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:43.456560 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12d002cf-1313-428b-9c5e-89742506d0b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:43.457363 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12d002cf-1313-428b-9c5e-89742506d0b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:43.457804 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12d002cf-1313-428b-9c5e-89742506d0b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:43.472772 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:43.607881 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-12d002cf-1313-428b-9c5e-89742506d0b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:43.616231 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-12d002cf-1313-428b-9c5e-89742506d0b4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.172180 Jul 18 17:01:43.616807 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 608/1211] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:43 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:43.822729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-09de8dba-b1b9-4fd6-83bf-60fcf80ba51c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:43.824018 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-09de8dba-b1b9-4fd6-83bf-60fcf80ba51c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:43.831506 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09de8dba-b1b9-4fd6-83bf-60fcf80ba51c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:43.832247 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09de8dba-b1b9-4fd6-83bf-60fcf80ba51c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:43.833043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09de8dba-b1b9-4fd6-83bf-60fcf80ba51c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:43.833480 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09de8dba-b1b9-4fd6-83bf-60fcf80ba51c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:44.016723 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-09de8dba-b1b9-4fd6-83bf-60fcf80ba51c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:44.030641 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-09de8dba-b1b9-4fd6-83bf-60fcf80ba51c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:44.032559 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-09de8dba-b1b9-4fd6-83bf-60fcf80ba51c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:44.033753 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-09de8dba-b1b9-4fd6-83bf-60fcf80ba51c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.215059 Jul 18 17:01:44.034334 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 604/1212] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:43 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:44.561497 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-d77bcbb7-8d28-4718-bc4f-eac657224326 req-2ef67526-bbcc-482e-a261-59b8d86b8e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f024cc-89d3-458a-9095-be12de8d51ee", "name": "network-vif-plugged", "status": "completed", "tag": "be58750b-20bf-4709-a370-f4aa2631f5f9"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:44.565914 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:44.571265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-d77bcbb7-8d28-4718-bc4f-eac657224326 req-2ef67526-bbcc-482e-a261-59b8d86b8e5b service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:44.575106 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-d77bcbb7-8d28-4718-bc4f-eac657224326 req-2ef67526-bbcc-482e-a261-59b8d86b8e5b service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:44.584108 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-d77bcbb7-8d28-4718-bc4f-eac657224326 req-2ef67526-bbcc-482e-a261-59b8d86b8e5b service nova] Creating event network-vif-plugged:be58750b-20bf-4709-a370-f4aa2631f5f9 for instance 79f024cc-89d3-458a-9095-be12de8d51ee on hv-cinder-83754 Jul 18 17:01:44.589323 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-d77bcbb7-8d28-4718-bc4f-eac657224326 req-2ef67526-bbcc-482e-a261-59b8d86b8e5b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032689 Jul 18 17:01:44.590111 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 609/1213] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:44.633978 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-628942a0-0c90-4064-bb7a-b4f6dcc84bdc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:44.634581 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-628942a0-0c90-4064-bb7a-b4f6dcc84bdc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:44.642259 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-628942a0-0c90-4064-bb7a-b4f6dcc84bdc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:44.642951 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-628942a0-0c90-4064-bb7a-b4f6dcc84bdc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:44.643925 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-628942a0-0c90-4064-bb7a-b4f6dcc84bdc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:44.644516 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-628942a0-0c90-4064-bb7a-b4f6dcc84bdc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:44.807962 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-628942a0-0c90-4064-bb7a-b4f6dcc84bdc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:44.817325 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-628942a0-0c90-4064-bb7a-b4f6dcc84bdc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.187340 Jul 18 17:01:44.817932 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 605/1214] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:44 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:45.057939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4d31c7bb-81cf-44fc-b3ad-72f82da75c3f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:45.058935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4d31c7bb-81cf-44fc-b3ad-72f82da75c3f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:45.066805 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4d31c7bb-81cf-44fc-b3ad-72f82da75c3f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:45.067479 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4d31c7bb-81cf-44fc-b3ad-72f82da75c3f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:45.068267 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4d31c7bb-81cf-44fc-b3ad-72f82da75c3f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:45.068712 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4d31c7bb-81cf-44fc-b3ad-72f82da75c3f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:45.231640 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4d31c7bb-81cf-44fc-b3ad-72f82da75c3f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:45.240691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4d31c7bb-81cf-44fc-b3ad-72f82da75c3f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:45.242228 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4d31c7bb-81cf-44fc-b3ad-72f82da75c3f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:45.243392 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4d31c7bb-81cf-44fc-b3ad-72f82da75c3f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.192992 Jul 18 17:01:45.243947 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 610/1215] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:45 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:45.835240 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f63be0e2-eeea-421c-a741-5f0baaf2162c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:45.836567 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f63be0e2-eeea-421c-a741-5f0baaf2162c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:45.840485 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:45.845110 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f63be0e2-eeea-421c-a741-5f0baaf2162c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:45.845671 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f63be0e2-eeea-421c-a741-5f0baaf2162c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:45.848646 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f63be0e2-eeea-421c-a741-5f0baaf2162c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:45.848646 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f63be0e2-eeea-421c-a741-5f0baaf2162c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:46.009389 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f63be0e2-eeea-421c-a741-5f0baaf2162c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:46.011562 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:46.018386 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f63be0e2-eeea-421c-a741-5f0baaf2162c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.187361 Jul 18 17:01:46.018963 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 606/1216] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:45 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:46.262751 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-23fcf7de-2184-42eb-abf1-abb2ab5c0e30 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:46.264154 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-23fcf7de-2184-42eb-abf1-abb2ab5c0e30 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:46.271196 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23fcf7de-2184-42eb-abf1-abb2ab5c0e30 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:46.271538 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23fcf7de-2184-42eb-abf1-abb2ab5c0e30 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:46.272313 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23fcf7de-2184-42eb-abf1-abb2ab5c0e30 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:46.272783 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23fcf7de-2184-42eb-abf1-abb2ab5c0e30 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:46.423384 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-23fcf7de-2184-42eb-abf1-abb2ab5c0e30 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:46.431472 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-23fcf7de-2184-42eb-abf1-abb2ab5c0e30 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:46.432923 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-23fcf7de-2184-42eb-abf1-abb2ab5c0e30 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:46.434110 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-23fcf7de-2184-42eb-abf1-abb2ab5c0e30 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.175246 Jul 18 17:01:46.434670 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 611/1217] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:46 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:47.036513 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-204b1217-c921-4a30-bc85-7d17f95805db tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:47.037338 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-204b1217-c921-4a30-bc85-7d17f95805db tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:47.044648 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-204b1217-c921-4a30-bc85-7d17f95805db tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:47.045139 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-204b1217-c921-4a30-bc85-7d17f95805db tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:47.045930 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-204b1217-c921-4a30-bc85-7d17f95805db tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:47.046366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-204b1217-c921-4a30-bc85-7d17f95805db tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:47.188560 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-204b1217-c921-4a30-bc85-7d17f95805db tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:47.196190 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-204b1217-c921-4a30-bc85-7d17f95805db tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.164043 Jul 18 17:01:47.196764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 607/1218] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:47 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:47.454074 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-795f8c92-1793-4fce-8128-9e9a12f63f11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:47.454626 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-795f8c92-1793-4fce-8128-9e9a12f63f11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:47.461281 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-795f8c92-1793-4fce-8128-9e9a12f63f11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:47.461733 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-795f8c92-1793-4fce-8128-9e9a12f63f11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:47.462497 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-795f8c92-1793-4fce-8128-9e9a12f63f11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:47.462979 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-795f8c92-1793-4fce-8128-9e9a12f63f11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:47.608863 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-795f8c92-1793-4fce-8128-9e9a12f63f11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:47.617495 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-795f8c92-1793-4fce-8128-9e9a12f63f11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:47.619022 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-795f8c92-1793-4fce-8128-9e9a12f63f11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:47.620410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-795f8c92-1793-4fce-8128-9e9a12f63f11 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.171007 Jul 18 17:01:47.621486 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 612/1219] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:47 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:48.214140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6bcec9f2-6e09-42b5-8ff7-97a8fe008e24 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:48.214862 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6bcec9f2-6e09-42b5-8ff7-97a8fe008e24 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:48.222819 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6bcec9f2-6e09-42b5-8ff7-97a8fe008e24 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.223284 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6bcec9f2-6e09-42b5-8ff7-97a8fe008e24 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:48.224069 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6bcec9f2-6e09-42b5-8ff7-97a8fe008e24 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.225266 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6bcec9f2-6e09-42b5-8ff7-97a8fe008e24 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:48.371187 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6bcec9f2-6e09-42b5-8ff7-97a8fe008e24 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:48.381507 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6bcec9f2-6e09-42b5-8ff7-97a8fe008e24 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.171524 Jul 18 17:01:48.382198 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 608/1220] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:48 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:48.639954 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cd009bcf-77a4-4b84-8b40-51f25337c138 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:48.640555 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cd009bcf-77a4-4b84-8b40-51f25337c138 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:48.647221 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd009bcf-77a4-4b84-8b40-51f25337c138 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.647673 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd009bcf-77a4-4b84-8b40-51f25337c138 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:48.648440 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd009bcf-77a4-4b84-8b40-51f25337c138 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.648877 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd009bcf-77a4-4b84-8b40-51f25337c138 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:48.788777 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cd009bcf-77a4-4b84-8b40-51f25337c138 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:48.797532 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cd009bcf-77a4-4b84-8b40-51f25337c138 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:48.799057 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cd009bcf-77a4-4b84-8b40-51f25337c138 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:48.800243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cd009bcf-77a4-4b84-8b40-51f25337c138 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.164461 Jul 18 17:01:48.811299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 613/1221] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:48 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:49.399820 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-da1a28f2-5e34-4a02-9e4e-0ea4bd1e4bde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:49.400484 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-da1a28f2-5e34-4a02-9e4e-0ea4bd1e4bde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:49.407978 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-da1a28f2-5e34-4a02-9e4e-0ea4bd1e4bde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:49.408433 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-da1a28f2-5e34-4a02-9e4e-0ea4bd1e4bde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:49.409252 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-da1a28f2-5e34-4a02-9e4e-0ea4bd1e4bde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:49.409695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-da1a28f2-5e34-4a02-9e4e-0ea4bd1e4bde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:49.547086 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-da1a28f2-5e34-4a02-9e4e-0ea4bd1e4bde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:49.555192 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-da1a28f2-5e34-4a02-9e4e-0ea4bd1e4bde tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.159178 Jul 18 17:01:49.565987 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 609/1222] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:49 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:49.818652 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-74be0bcd-912a-498b-af49-277747bfad38 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:49.819261 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-74be0bcd-912a-498b-af49-277747bfad38 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:49.826216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-74be0bcd-912a-498b-af49-277747bfad38 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:49.826672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-74be0bcd-912a-498b-af49-277747bfad38 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:49.827448 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-74be0bcd-912a-498b-af49-277747bfad38 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:49.827892 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-74be0bcd-912a-498b-af49-277747bfad38 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:49.967145 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-74be0bcd-912a-498b-af49-277747bfad38 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:49.975920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-74be0bcd-912a-498b-af49-277747bfad38 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:49.977471 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-74be0bcd-912a-498b-af49-277747bfad38 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:49.978648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-74be0bcd-912a-498b-af49-277747bfad38 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.163947 Jul 18 17:01:49.990599 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 614/1223] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:49 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:50.572990 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d93354b8-0d41-4667-9bc0-9a147fe811ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:50.573624 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d93354b8-0d41-4667-9bc0-9a147fe811ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:50.581275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d93354b8-0d41-4667-9bc0-9a147fe811ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.581724 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d93354b8-0d41-4667-9bc0-9a147fe811ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.582486 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d93354b8-0d41-4667-9bc0-9a147fe811ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.582921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d93354b8-0d41-4667-9bc0-9a147fe811ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.748430 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d93354b8-0d41-4667-9bc0-9a147fe811ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:50.756016 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d93354b8-0d41-4667-9bc0-9a147fe811ac tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.186804 Jul 18 17:01:50.756584 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 610/1224] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:50 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:50.998058 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6656f366-ac0d-4248-9157-2899c74acc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:50.999931 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6656f366-ac0d-4248-9157-2899c74acc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:51.009608 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6656f366-ac0d-4248-9157-2899c74acc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:51.009800 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6656f366-ac0d-4248-9157-2899c74acc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:51.012084 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6656f366-ac0d-4248-9157-2899c74acc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:51.012084 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6656f366-ac0d-4248-9157-2899c74acc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:51.157466 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6656f366-ac0d-4248-9157-2899c74acc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:51.165400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6656f366-ac0d-4248-9157-2899c74acc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:51.166891 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6656f366-ac0d-4248-9157-2899c74acc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:51.168050 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6656f366-ac0d-4248-9157-2899c74acc5c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.174110 Jul 18 17:01:51.168596 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 615/1225] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:50 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:51.774050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-82b66c57-fae7-41fa-bfd0-ad49a5646428 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:51.774653 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-82b66c57-fae7-41fa-bfd0-ad49a5646428 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:51.782781 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-82b66c57-fae7-41fa-bfd0-ad49a5646428 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:51.783226 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-82b66c57-fae7-41fa-bfd0-ad49a5646428 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:51.783983 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-82b66c57-fae7-41fa-bfd0-ad49a5646428 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:51.784423 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-82b66c57-fae7-41fa-bfd0-ad49a5646428 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:51.933305 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-82b66c57-fae7-41fa-bfd0-ad49a5646428 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:51.941338 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-82b66c57-fae7-41fa-bfd0-ad49a5646428 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.171081 Jul 18 17:01:51.942344 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 611/1226] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:51 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:52.187140 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-02fb0669-c066-4cdf-b727-172f0c6abb23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:52.187749 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-02fb0669-c066-4cdf-b727-172f0c6abb23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:52.194520 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-02fb0669-c066-4cdf-b727-172f0c6abb23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:52.194969 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-02fb0669-c066-4cdf-b727-172f0c6abb23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:52.195741 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-02fb0669-c066-4cdf-b727-172f0c6abb23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:52.196181 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-02fb0669-c066-4cdf-b727-172f0c6abb23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:52.333875 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-02fb0669-c066-4cdf-b727-172f0c6abb23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:52.356345 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-02fb0669-c066-4cdf-b727-172f0c6abb23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:52.357897 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-02fb0669-c066-4cdf-b727-172f0c6abb23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:52.359101 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-02fb0669-c066-4cdf-b727-172f0c6abb23 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.176705 Jul 18 17:01:52.359903 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 616/1227] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:52 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:52.962504 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2be220dc-b616-4da7-9bd4-cf7a2908ba9f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:52.963309 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2be220dc-b616-4da7-9bd4-cf7a2908ba9f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:52.970480 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2be220dc-b616-4da7-9bd4-cf7a2908ba9f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:52.970930 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2be220dc-b616-4da7-9bd4-cf7a2908ba9f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:52.971705 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2be220dc-b616-4da7-9bd4-cf7a2908ba9f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:52.972136 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2be220dc-b616-4da7-9bd4-cf7a2908ba9f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:53.123090 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2be220dc-b616-4da7-9bd4-cf7a2908ba9f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:53.130510 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2be220dc-b616-4da7-9bd4-cf7a2908ba9f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.175228 Jul 18 17:01:53.131074 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 612/1228] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:52 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:53.378533 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4dc5d33f-11a5-4f2c-b004-04b1bd817162 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:53.379149 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4dc5d33f-11a5-4f2c-b004-04b1bd817162 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:53.388232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4dc5d33f-11a5-4f2c-b004-04b1bd817162 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:53.388706 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4dc5d33f-11a5-4f2c-b004-04b1bd817162 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:53.389530 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4dc5d33f-11a5-4f2c-b004-04b1bd817162 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:53.389978 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4dc5d33f-11a5-4f2c-b004-04b1bd817162 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:53.546186 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4dc5d33f-11a5-4f2c-b004-04b1bd817162 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:53.554490 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4dc5d33f-11a5-4f2c-b004-04b1bd817162 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:53.555975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4dc5d33f-11a5-4f2c-b004-04b1bd817162 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:53.557219 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4dc5d33f-11a5-4f2c-b004-04b1bd817162 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.182911 Jul 18 17:01:53.557778 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 617/1229] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:53 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:54.147726 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6269fe82-4e25-4a4d-9157-94eebceeefdd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:54.148342 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6269fe82-4e25-4a4d-9157-94eebceeefdd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:54.155644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6269fe82-4e25-4a4d-9157-94eebceeefdd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:54.156095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6269fe82-4e25-4a4d-9157-94eebceeefdd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:54.156871 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6269fe82-4e25-4a4d-9157-94eebceeefdd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:54.157345 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6269fe82-4e25-4a4d-9157-94eebceeefdd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:54.287674 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6269fe82-4e25-4a4d-9157-94eebceeefdd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:54.295887 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6269fe82-4e25-4a4d-9157-94eebceeefdd tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.151357 Jul 18 17:01:54.296469 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 613/1230] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:54 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:54.578186 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-875c288b-30be-4523-886e-97b3e1456ff6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:54.578860 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-875c288b-30be-4523-886e-97b3e1456ff6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:54.585551 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-875c288b-30be-4523-886e-97b3e1456ff6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:54.586002 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-875c288b-30be-4523-886e-97b3e1456ff6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:54.586773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-875c288b-30be-4523-886e-97b3e1456ff6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:54.587217 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-875c288b-30be-4523-886e-97b3e1456ff6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:54.730851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-875c288b-30be-4523-886e-97b3e1456ff6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:54.740960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-875c288b-30be-4523-886e-97b3e1456ff6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:54.742532 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-875c288b-30be-4523-886e-97b3e1456ff6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:54.743709 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-875c288b-30be-4523-886e-97b3e1456ff6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.170172 Jul 18 17:01:54.744265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 618/1231] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:54 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:55.312101 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3e586acd-9eb9-42d9-bf6e-902200776904 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:55.312718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3e586acd-9eb9-42d9-bf6e-902200776904 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:55.319522 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3e586acd-9eb9-42d9-bf6e-902200776904 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:55.319973 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3e586acd-9eb9-42d9-bf6e-902200776904 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:55.320746 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3e586acd-9eb9-42d9-bf6e-902200776904 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:55.321375 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3e586acd-9eb9-42d9-bf6e-902200776904 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:55.463723 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3e586acd-9eb9-42d9-bf6e-902200776904 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:55.472751 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3e586acd-9eb9-42d9-bf6e-902200776904 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.164699 Jul 18 17:01:55.480635 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 614/1232] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:55 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:55.764655 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-88a96209-40f9-411c-b79d-4cf6aeb161bd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:55.765645 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-88a96209-40f9-411c-b79d-4cf6aeb161bd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:55.777407 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88a96209-40f9-411c-b79d-4cf6aeb161bd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:55.778453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88a96209-40f9-411c-b79d-4cf6aeb161bd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:55.780619 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88a96209-40f9-411c-b79d-4cf6aeb161bd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:55.781422 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88a96209-40f9-411c-b79d-4cf6aeb161bd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:55.942611 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-88a96209-40f9-411c-b79d-4cf6aeb161bd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:55.953986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-88a96209-40f9-411c-b79d-4cf6aeb161bd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:55.955934 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-88a96209-40f9-411c-b79d-4cf6aeb161bd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:55.957394 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-88a96209-40f9-411c-b79d-4cf6aeb161bd tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.198013 Jul 18 17:01:55.958073 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 619/1233] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:55 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:56.497092 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-52a13973-6082-4199-abb7-56e261859720 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:56.497673 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-52a13973-6082-4199-abb7-56e261859720 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:56.504831 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-52a13973-6082-4199-abb7-56e261859720 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:56.505333 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-52a13973-6082-4199-abb7-56e261859720 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:56.506135 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-52a13973-6082-4199-abb7-56e261859720 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:56.506581 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-52a13973-6082-4199-abb7-56e261859720 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:56.645593 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-52a13973-6082-4199-abb7-56e261859720 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:56.653027 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-52a13973-6082-4199-abb7-56e261859720 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.160049 Jul 18 17:01:56.653592 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 615/1234] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:56 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:56.976283 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3f0b3187-7ade-4b5e-a0ad-5019e4650df0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:56.976906 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3f0b3187-7ade-4b5e-a0ad-5019e4650df0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:56.983908 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3f0b3187-7ade-4b5e-a0ad-5019e4650df0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:56.984361 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3f0b3187-7ade-4b5e-a0ad-5019e4650df0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:56.985158 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3f0b3187-7ade-4b5e-a0ad-5019e4650df0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:56.985864 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3f0b3187-7ade-4b5e-a0ad-5019e4650df0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.126135 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3f0b3187-7ade-4b5e-a0ad-5019e4650df0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:57.134445 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3f0b3187-7ade-4b5e-a0ad-5019e4650df0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:57.135949 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3f0b3187-7ade-4b5e-a0ad-5019e4650df0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:57.137161 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3f0b3187-7ade-4b5e-a0ad-5019e4650df0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.164778 Jul 18 17:01:57.137707 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 620/1235] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:56 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:57.669971 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f2e94a5a-57a5-43e9-aaf8-a3efb9d2eefb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:57.670770 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f2e94a5a-57a5-43e9-aaf8-a3efb9d2eefb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:57.677300 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2e94a5a-57a5-43e9-aaf8-a3efb9d2eefb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:57.677755 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2e94a5a-57a5-43e9-aaf8-a3efb9d2eefb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.678518 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2e94a5a-57a5-43e9-aaf8-a3efb9d2eefb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:57.678964 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2e94a5a-57a5-43e9-aaf8-a3efb9d2eefb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.820828 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f2e94a5a-57a5-43e9-aaf8-a3efb9d2eefb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:57.829338 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f2e94a5a-57a5-43e9-aaf8-a3efb9d2eefb tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.163109 Jul 18 17:01:57.832815 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 616/1236] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:57 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:58.156071 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a725a2f4-1f30-43fe-aae6-e9549ee565ec tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:58.156639 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a725a2f4-1f30-43fe-aae6-e9549ee565ec tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:58.163441 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a725a2f4-1f30-43fe-aae6-e9549ee565ec tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.163897 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a725a2f4-1f30-43fe-aae6-e9549ee565ec tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.164662 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a725a2f4-1f30-43fe-aae6-e9549ee565ec tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.165121 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a725a2f4-1f30-43fe-aae6-e9549ee565ec tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.297156 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a725a2f4-1f30-43fe-aae6-e9549ee565ec tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:58.305185 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a725a2f4-1f30-43fe-aae6-e9549ee565ec tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:58.306702 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a725a2f4-1f30-43fe-aae6-e9549ee565ec tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:58.308182 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a725a2f4-1f30-43fe-aae6-e9549ee565ec tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.156981 Jul 18 17:01:58.308385 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 621/1237] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:58 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:58.846541 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ffbbeb26-0bad-4d32-b4af-9ea8fc18e086 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:58.847180 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ffbbeb26-0bad-4d32-b4af-9ea8fc18e086 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:58.853796 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ffbbeb26-0bad-4d32-b4af-9ea8fc18e086 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.854254 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ffbbeb26-0bad-4d32-b4af-9ea8fc18e086 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.855016 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ffbbeb26-0bad-4d32-b4af-9ea8fc18e086 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.855457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ffbbeb26-0bad-4d32-b4af-9ea8fc18e086 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.990687 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ffbbeb26-0bad-4d32-b4af-9ea8fc18e086 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:59.002576 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ffbbeb26-0bad-4d32-b4af-9ea8fc18e086 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.160558 Jul 18 17:01:59.003375 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 617/1238] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:58 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:59.325849 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7a29ceb8-8315-422e-93ae-f76f80f09305 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:59.327065 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7a29ceb8-8315-422e-93ae-f76f80f09305 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:59.333621 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a29ceb8-8315-422e-93ae-f76f80f09305 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:59.334082 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a29ceb8-8315-422e-93ae-f76f80f09305 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:59.334852 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a29ceb8-8315-422e-93ae-f76f80f09305 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:59.335295 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a29ceb8-8315-422e-93ae-f76f80f09305 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:59.476595 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7a29ceb8-8315-422e-93ae-f76f80f09305 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:59.486330 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7a29ceb8-8315-422e-93ae-f76f80f09305 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:59.487936 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7a29ceb8-8315-422e-93ae-f76f80f09305 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:59.489199 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7a29ceb8-8315-422e-93ae-f76f80f09305 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.167294 Jul 18 17:01:59.489788 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 622/1239] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:59 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:00.019391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6fb543fc-3a6f-4945-9b13-73ebe48c4f21 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:00.020014 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6fb543fc-3a6f-4945-9b13-73ebe48c4f21 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:00.026480 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6fb543fc-3a6f-4945-9b13-73ebe48c4f21 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:00.026931 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6fb543fc-3a6f-4945-9b13-73ebe48c4f21 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:00.027693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6fb543fc-3a6f-4945-9b13-73ebe48c4f21 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:00.028132 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6fb543fc-3a6f-4945-9b13-73ebe48c4f21 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:00.168325 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6fb543fc-3a6f-4945-9b13-73ebe48c4f21 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:00.186217 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6fb543fc-3a6f-4945-9b13-73ebe48c4f21 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.169350 Jul 18 17:02:00.186392 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 618/1240] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:00 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:00.508887 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fdb435b1-dd77-43a3-a139-69516442379b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:00.509526 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fdb435b1-dd77-43a3-a139-69516442379b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:00.516275 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fdb435b1-dd77-43a3-a139-69516442379b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:00.516723 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fdb435b1-dd77-43a3-a139-69516442379b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:00.517514 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fdb435b1-dd77-43a3-a139-69516442379b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:00.517952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fdb435b1-dd77-43a3-a139-69516442379b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:00.650687 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fdb435b1-dd77-43a3-a139-69516442379b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:00.659292 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fdb435b1-dd77-43a3-a139-69516442379b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:00.660797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fdb435b1-dd77-43a3-a139-69516442379b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:00.661979 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fdb435b1-dd77-43a3-a139-69516442379b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.156915 Jul 18 17:02:00.662534 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 623/1241] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:00 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:01.203276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ad21a96a-2761-4ef9-ac01-43a9c54ccb9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:01.203884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ad21a96a-2761-4ef9-ac01-43a9c54ccb9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:01.210512 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ad21a96a-2761-4ef9-ac01-43a9c54ccb9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:01.210971 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ad21a96a-2761-4ef9-ac01-43a9c54ccb9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:01.211725 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ad21a96a-2761-4ef9-ac01-43a9c54ccb9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:01.212156 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ad21a96a-2761-4ef9-ac01-43a9c54ccb9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:01.351084 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ad21a96a-2761-4ef9-ac01-43a9c54ccb9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:01.359161 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ad21a96a-2761-4ef9-ac01-43a9c54ccb9c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.160384 Jul 18 17:02:01.359733 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 619/1242] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:01 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:01.680060 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-89e2ff64-5933-4767-87aa-04116bb96afa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:01.680663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-89e2ff64-5933-4767-87aa-04116bb96afa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:01.687981 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89e2ff64-5933-4767-87aa-04116bb96afa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:01.688433 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89e2ff64-5933-4767-87aa-04116bb96afa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:01.689226 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89e2ff64-5933-4767-87aa-04116bb96afa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:01.689663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89e2ff64-5933-4767-87aa-04116bb96afa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:01.828917 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-89e2ff64-5933-4767-87aa-04116bb96afa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:01.843242 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-89e2ff64-5933-4767-87aa-04116bb96afa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:01.844756 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-89e2ff64-5933-4767-87aa-04116bb96afa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:01.845989 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-89e2ff64-5933-4767-87aa-04116bb96afa tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.169797 Jul 18 17:02:01.849664 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 624/1243] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:01 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:02.376715 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7147ae6d-634a-4ee9-a9da-911c95f9d1ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:02.377394 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7147ae6d-634a-4ee9-a9da-911c95f9d1ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:02.384431 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7147ae6d-634a-4ee9-a9da-911c95f9d1ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:02.385861 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7147ae6d-634a-4ee9-a9da-911c95f9d1ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:02.385861 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7147ae6d-634a-4ee9-a9da-911c95f9d1ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:02.386149 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7147ae6d-634a-4ee9-a9da-911c95f9d1ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:02.522558 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7147ae6d-634a-4ee9-a9da-911c95f9d1ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:02.531809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7147ae6d-634a-4ee9-a9da-911c95f9d1ad tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.157786 Jul 18 17:02:02.531809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 620/1244] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:02 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:02.869427 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9020de89-fe05-4c28-9ea3-0cdd6aab9605 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:02.870214 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9020de89-fe05-4c28-9ea3-0cdd6aab9605 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:02.877466 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9020de89-fe05-4c28-9ea3-0cdd6aab9605 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:02.881567 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9020de89-fe05-4c28-9ea3-0cdd6aab9605 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:02.881567 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9020de89-fe05-4c28-9ea3-0cdd6aab9605 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:02.881567 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9020de89-fe05-4c28-9ea3-0cdd6aab9605 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:03.013104 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9020de89-fe05-4c28-9ea3-0cdd6aab9605 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:03.015575 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:03.022042 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9020de89-fe05-4c28-9ea3-0cdd6aab9605 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:03.028410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9020de89-fe05-4c28-9ea3-0cdd6aab9605 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:03.028410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9020de89-fe05-4c28-9ea3-0cdd6aab9605 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.159408 Jul 18 17:02:03.028410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 625/1245] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:02 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:03.547539 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cf7df6f5-4cb2-4646-9f93-7ca63d9f162b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:03.548167 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cf7df6f5-4cb2-4646-9f93-7ca63d9f162b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:03.555270 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cf7df6f5-4cb2-4646-9f93-7ca63d9f162b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:03.555731 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cf7df6f5-4cb2-4646-9f93-7ca63d9f162b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:03.556499 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cf7df6f5-4cb2-4646-9f93-7ca63d9f162b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:03.556956 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cf7df6f5-4cb2-4646-9f93-7ca63d9f162b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:03.703034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cf7df6f5-4cb2-4646-9f93-7ca63d9f162b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:03.710961 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cf7df6f5-4cb2-4646-9f93-7ca63d9f162b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.168037 Jul 18 17:02:03.711614 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 621/1246] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:03 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:04.044175 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ec325724-a08a-4318-9578-0748fdd71522 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:04.044901 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ec325724-a08a-4318-9578-0748fdd71522 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:04.052600 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec325724-a08a-4318-9578-0748fdd71522 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:04.053086 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec325724-a08a-4318-9578-0748fdd71522 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:04.053874 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec325724-a08a-4318-9578-0748fdd71522 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:04.054317 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec325724-a08a-4318-9578-0748fdd71522 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:04.193906 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ec325724-a08a-4318-9578-0748fdd71522 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:04.202922 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ec325724-a08a-4318-9578-0748fdd71522 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:04.204588 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ec325724-a08a-4318-9578-0748fdd71522 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:04.205865 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ec325724-a08a-4318-9578-0748fdd71522 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.166010 Jul 18 17:02:04.206453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 626/1247] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:04 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:04.727945 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-36b9e0f3-3bdd-4a64-bf31-e2ebbbc5ecbc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:04.728587 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-36b9e0f3-3bdd-4a64-bf31-e2ebbbc5ecbc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:04.736175 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36b9e0f3-3bdd-4a64-bf31-e2ebbbc5ecbc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:04.736624 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36b9e0f3-3bdd-4a64-bf31-e2ebbbc5ecbc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:04.737418 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36b9e0f3-3bdd-4a64-bf31-e2ebbbc5ecbc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:04.737856 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36b9e0f3-3bdd-4a64-bf31-e2ebbbc5ecbc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:04.872982 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-36b9e0f3-3bdd-4a64-bf31-e2ebbbc5ecbc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:04.880411 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-36b9e0f3-3bdd-4a64-bf31-e2ebbbc5ecbc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.156337 Jul 18 17:02:04.880968 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 622/1248] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:04 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:05.224033 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c4d5ff03-1edb-411a-a068-c613911a1895 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:05.225844 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c4d5ff03-1edb-411a-a068-c613911a1895 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:05.231455 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c4d5ff03-1edb-411a-a068-c613911a1895 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:05.231941 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c4d5ff03-1edb-411a-a068-c613911a1895 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:05.233210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c4d5ff03-1edb-411a-a068-c613911a1895 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:05.233334 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c4d5ff03-1edb-411a-a068-c613911a1895 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:05.368931 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c4d5ff03-1edb-411a-a068-c613911a1895 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:05.377440 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c4d5ff03-1edb-411a-a068-c613911a1895 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:05.378940 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c4d5ff03-1edb-411a-a068-c613911a1895 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:05.380290 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c4d5ff03-1edb-411a-a068-c613911a1895 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.160137 Jul 18 17:02:05.380843 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 627/1249] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:05 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:05.897775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a5f9b747-96c6-4b1a-8661-ccad782c520c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:05.898378 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a5f9b747-96c6-4b1a-8661-ccad782c520c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:05.904872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a5f9b747-96c6-4b1a-8661-ccad782c520c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:05.905339 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a5f9b747-96c6-4b1a-8661-ccad782c520c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:05.906176 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a5f9b747-96c6-4b1a-8661-ccad782c520c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:05.906608 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a5f9b747-96c6-4b1a-8661-ccad782c520c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:05.922887 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:06.042143 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a5f9b747-96c6-4b1a-8661-ccad782c520c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:06.050321 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a5f9b747-96c6-4b1a-8661-ccad782c520c tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.156953 Jul 18 17:02:06.050892 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 623/1250] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:05 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:06.399998 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ae586d3f-4054-407e-9caf-6908eae2ac79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:06.400629 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ae586d3f-4054-407e-9caf-6908eae2ac79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:06.407980 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae586d3f-4054-407e-9caf-6908eae2ac79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:06.408448 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae586d3f-4054-407e-9caf-6908eae2ac79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:06.409293 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae586d3f-4054-407e-9caf-6908eae2ac79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:06.409797 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ae586d3f-4054-407e-9caf-6908eae2ac79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:06.540847 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ae586d3f-4054-407e-9caf-6908eae2ac79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:06.549033 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ae586d3f-4054-407e-9caf-6908eae2ac79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:06.550535 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ae586d3f-4054-407e-9caf-6908eae2ac79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:06.551681 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ae586d3f-4054-407e-9caf-6908eae2ac79 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.155861 Jul 18 17:02:06.552236 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 628/1251] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:06 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:07.067535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0d5c5d44-d2ce-4a14-a46f-c2b7f126d0f2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:07.068164 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0d5c5d44-d2ce-4a14-a46f-c2b7f126d0f2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:07.075028 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d5c5d44-d2ce-4a14-a46f-c2b7f126d0f2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:07.075487 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d5c5d44-d2ce-4a14-a46f-c2b7f126d0f2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:07.076415 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d5c5d44-d2ce-4a14-a46f-c2b7f126d0f2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:07.076922 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d5c5d44-d2ce-4a14-a46f-c2b7f126d0f2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:07.211259 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0d5c5d44-d2ce-4a14-a46f-c2b7f126d0f2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:07.219696 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0d5c5d44-d2ce-4a14-a46f-c2b7f126d0f2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.156097 Jul 18 17:02:07.220465 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 624/1252] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:07 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:07.570399 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f6456bde-9b22-42d7-b7af-3d60bbd340c2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:07.571469 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f6456bde-9b22-42d7-b7af-3d60bbd340c2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:07.578334 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f6456bde-9b22-42d7-b7af-3d60bbd340c2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:07.578792 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f6456bde-9b22-42d7-b7af-3d60bbd340c2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:07.579656 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f6456bde-9b22-42d7-b7af-3d60bbd340c2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:07.580166 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f6456bde-9b22-42d7-b7af-3d60bbd340c2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:07.714242 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f6456bde-9b22-42d7-b7af-3d60bbd340c2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:07.723724 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f6456bde-9b22-42d7-b7af-3d60bbd340c2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:07.725070 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f6456bde-9b22-42d7-b7af-3d60bbd340c2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:07.726278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f6456bde-9b22-42d7-b7af-3d60bbd340c2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.159773 Jul 18 17:02:07.727043 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 629/1253] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:07 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:08.237107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b26cea7d-a7d3-4ff3-8f41-a834df7ec1b0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:08.237734 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b26cea7d-a7d3-4ff3-8f41-a834df7ec1b0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:08.243817 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b26cea7d-a7d3-4ff3-8f41-a834df7ec1b0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:08.244294 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b26cea7d-a7d3-4ff3-8f41-a834df7ec1b0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:08.245133 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b26cea7d-a7d3-4ff3-8f41-a834df7ec1b0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:08.245575 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b26cea7d-a7d3-4ff3-8f41-a834df7ec1b0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:08.379872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b26cea7d-a7d3-4ff3-8f41-a834df7ec1b0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:08.387645 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b26cea7d-a7d3-4ff3-8f41-a834df7ec1b0 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.155770 Jul 18 17:02:08.388723 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 625/1254] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:08 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:08.745102 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-69ef4db2-8b4e-404e-ac19-83fec04a91e2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:08.745644 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-69ef4db2-8b4e-404e-ac19-83fec04a91e2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:08.752759 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-69ef4db2-8b4e-404e-ac19-83fec04a91e2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:08.753242 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-69ef4db2-8b4e-404e-ac19-83fec04a91e2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:08.754002 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-69ef4db2-8b4e-404e-ac19-83fec04a91e2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:08.754433 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-69ef4db2-8b4e-404e-ac19-83fec04a91e2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:08.890046 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-69ef4db2-8b4e-404e-ac19-83fec04a91e2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:08.898176 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-69ef4db2-8b4e-404e-ac19-83fec04a91e2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:08.900079 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-69ef4db2-8b4e-404e-ac19-83fec04a91e2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:08.901354 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-69ef4db2-8b4e-404e-ac19-83fec04a91e2 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.160537 Jul 18 17:02:08.902039 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 630/1255] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:08 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:09.406425 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e3f19a48-9021-42d8-8935-bdd5b561fec2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:09.407041 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e3f19a48-9021-42d8-8935-bdd5b561fec2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:09.413866 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e3f19a48-9021-42d8-8935-bdd5b561fec2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:09.414313 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e3f19a48-9021-42d8-8935-bdd5b561fec2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:09.415101 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e3f19a48-9021-42d8-8935-bdd5b561fec2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:09.415532 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e3f19a48-9021-42d8-8935-bdd5b561fec2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:09.554486 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e3f19a48-9021-42d8-8935-bdd5b561fec2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:09.561983 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e3f19a48-9021-42d8-8935-bdd5b561fec2 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.160444 Jul 18 17:02:09.562541 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 626/1256] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:09 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:09.919778 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f6135f0d-e82d-4da3-80c9-5de011fb70ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:09.920676 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f6135f0d-e82d-4da3-80c9-5de011fb70ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:09.927320 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f6135f0d-e82d-4da3-80c9-5de011fb70ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:09.927795 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f6135f0d-e82d-4da3-80c9-5de011fb70ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:09.928542 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f6135f0d-e82d-4da3-80c9-5de011fb70ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:09.928978 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f6135f0d-e82d-4da3-80c9-5de011fb70ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.067097 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f6135f0d-e82d-4da3-80c9-5de011fb70ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:10.075095 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f6135f0d-e82d-4da3-80c9-5de011fb70ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:10.077373 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f6135f0d-e82d-4da3-80c9-5de011fb70ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:10.078563 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f6135f0d-e82d-4da3-80c9-5de011fb70ed tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.162729 Jul 18 17:02:10.079104 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 631/1257] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:09 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:10.578877 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4e194c79-73ec-4dbd-9358-1e8bcb3f0c3f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:10.579490 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4e194c79-73ec-4dbd-9358-1e8bcb3f0c3f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:10.585707 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e194c79-73ec-4dbd-9358-1e8bcb3f0c3f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.586160 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e194c79-73ec-4dbd-9358-1e8bcb3f0c3f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.586928 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e194c79-73ec-4dbd-9358-1e8bcb3f0c3f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.587366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e194c79-73ec-4dbd-9358-1e8bcb3f0c3f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.722222 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4e194c79-73ec-4dbd-9358-1e8bcb3f0c3f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:10.730903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4e194c79-73ec-4dbd-9358-1e8bcb3f0c3f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.156201 Jul 18 17:02:10.731475 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 627/1258] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:10 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:11.097570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1f2c187d-9781-4c01-8d4f-6ea6448806f6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:11.098175 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1f2c187d-9781-4c01-8d4f-6ea6448806f6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:11.104793 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1f2c187d-9781-4c01-8d4f-6ea6448806f6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:11.105276 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1f2c187d-9781-4c01-8d4f-6ea6448806f6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:11.106050 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1f2c187d-9781-4c01-8d4f-6ea6448806f6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:11.106497 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1f2c187d-9781-4c01-8d4f-6ea6448806f6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:11.247589 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1f2c187d-9781-4c01-8d4f-6ea6448806f6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:11.256051 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1f2c187d-9781-4c01-8d4f-6ea6448806f6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:11.257598 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1f2c187d-9781-4c01-8d4f-6ea6448806f6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:11.258781 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1f2c187d-9781-4c01-8d4f-6ea6448806f6 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.165178 Jul 18 17:02:11.259444 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 632/1259] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:11 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:11.749637 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-473394df-a216-4d51-9f6c-e9bfa92f76ae tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:11.750397 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-473394df-a216-4d51-9f6c-e9bfa92f76ae tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:11.756811 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-473394df-a216-4d51-9f6c-e9bfa92f76ae tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:11.757291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-473394df-a216-4d51-9f6c-e9bfa92f76ae tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:11.758051 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-473394df-a216-4d51-9f6c-e9bfa92f76ae tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:11.758485 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-473394df-a216-4d51-9f6c-e9bfa92f76ae tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:11.894475 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-473394df-a216-4d51-9f6c-e9bfa92f76ae tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:11.902175 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-473394df-a216-4d51-9f6c-e9bfa92f76ae tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1367 microversion: 2.1 time: 0.156986 Jul 18 17:02:11.902714 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 628/1260] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:11 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:12.278852 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1ef0f338-ec54-45d3-97a6-14633982416b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:12.281298 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1ef0f338-ec54-45d3-97a6-14633982416b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:12.288854 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ef0f338-ec54-45d3-97a6-14633982416b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:12.289413 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ef0f338-ec54-45d3-97a6-14633982416b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:12.290254 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ef0f338-ec54-45d3-97a6-14633982416b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:12.290859 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ef0f338-ec54-45d3-97a6-14633982416b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:12.495728 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1ef0f338-ec54-45d3-97a6-14633982416b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:12.506172 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1ef0f338-ec54-45d3-97a6-14633982416b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:12.507848 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1ef0f338-ec54-45d3-97a6-14633982416b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:12.509070 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1ef0f338-ec54-45d3-97a6-14633982416b tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.234405 Jul 18 17:02:12.509636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 633/1261] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:12 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:12.918179 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8cf15330-cfce-4bd7-a5a7-679a8e7c4bd7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:12.918799 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8cf15330-cfce-4bd7-a5a7-679a8e7c4bd7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:12.926963 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8cf15330-cfce-4bd7-a5a7-679a8e7c4bd7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:12.926963 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8cf15330-cfce-4bd7-a5a7-679a8e7c4bd7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:12.927902 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8cf15330-cfce-4bd7-a5a7-679a8e7c4bd7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:12.928611 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8cf15330-cfce-4bd7-a5a7-679a8e7c4bd7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:13.071098 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8cf15330-cfce-4bd7-a5a7-679a8e7c4bd7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:13.079036 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8cf15330-cfce-4bd7-a5a7-679a8e7c4bd7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1558 microversion: 2.1 time: 0.164835 Jul 18 17:02:13.079614 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 629/1262] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:12 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:13.095916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-babcbda9-45c8-4364-a894-ca9fc2d608ec tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:13.096416 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-babcbda9-45c8-4364-a894-ca9fc2d608ec tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:13.102674 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-babcbda9-45c8-4364-a894-ca9fc2d608ec tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:13.103134 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-babcbda9-45c8-4364-a894-ca9fc2d608ec tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:13.103915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-babcbda9-45c8-4364-a894-ca9fc2d608ec tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:13.104393 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-babcbda9-45c8-4364-a894-ca9fc2d608ec tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:13.247520 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-babcbda9-45c8-4364-a894-ca9fc2d608ec tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156173 Jul 18 17:02:13.248681 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 634/1263] 10.222.0.76 () {58 vars in 1274 bytes} [Mon Jul 18 17:02:13 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:13.532226 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-048f0024-383c-428a-a9f3-aa0cef9496b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:13.532849 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-048f0024-383c-428a-a9f3-aa0cef9496b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:13.539657 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-048f0024-383c-428a-a9f3-aa0cef9496b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:13.540112 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-048f0024-383c-428a-a9f3-aa0cef9496b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:13.541110 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-048f0024-383c-428a-a9f3-aa0cef9496b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:13.541557 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-048f0024-383c-428a-a9f3-aa0cef9496b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:13.971024 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-048f0024-383c-428a-a9f3-aa0cef9496b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:13.980548 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-048f0024-383c-428a-a9f3-aa0cef9496b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:13.982105 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-048f0024-383c-428a-a9f3-aa0cef9496b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:13.984237 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-048f0024-383c-428a-a9f3-aa0cef9496b0 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.458716 Jul 18 17:02:13.985727 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 630/1264] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:13 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:14.553183 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-371109a9-f8ab-4dbd-9dad-07abe726ebdb req-6601e495-a374-453f-93f5-3446fc7d2f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55db823-1c00-4ca0-bc6f-cd070459c5e9", "name": "network-vif-plugged", "status": "completed", "tag": "2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:02:14.571863 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-371109a9-f8ab-4dbd-9dad-07abe726ebdb req-6601e495-a374-453f-93f5-3446fc7d2f1d service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:14.572320 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-371109a9-f8ab-4dbd-9dad-07abe726ebdb req-6601e495-a374-453f-93f5-3446fc7d2f1d service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:14.592454 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-371109a9-f8ab-4dbd-9dad-07abe726ebdb req-6601e495-a374-453f-93f5-3446fc7d2f1d service nova] Creating event network-vif-plugged:2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662 for instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 on hv-cinder-83754 Jul 18 17:02:14.598483 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-371109a9-f8ab-4dbd-9dad-07abe726ebdb req-6601e495-a374-453f-93f5-3446fc7d2f1d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051763 Jul 18 17:02:14.599401 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 635/1265] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:14.663917 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-b93565e4-5aac-46ac-a352-ad7473239ff7 req-8335957c-06b9-43c2-9855-55a4157493d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f024cc-89d3-458a-9095-be12de8d51ee", "tag": "be58750b-20bf-4709-a370-f4aa2631f5f9"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:02:14.685720 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-b93565e4-5aac-46ac-a352-ad7473239ff7 req-8335957c-06b9-43c2-9855-55a4157493d1 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:14.687251 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-b93565e4-5aac-46ac-a352-ad7473239ff7 req-8335957c-06b9-43c2-9855-55a4157493d1 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:14.708858 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-b93565e4-5aac-46ac-a352-ad7473239ff7 req-8335957c-06b9-43c2-9855-55a4157493d1 service nova] Creating event network-changed:be58750b-20bf-4709-a370-f4aa2631f5f9 for instance 79f024cc-89d3-458a-9095-be12de8d51ee on hv-cinder-83754 Jul 18 17:02:14.715248 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-b93565e4-5aac-46ac-a352-ad7473239ff7 req-8335957c-06b9-43c2-9855-55a4157493d1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055397 Jul 18 17:02:14.718719 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 631/1266] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:15.005549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7e2c66cd-c466-4711-92b3-1c2f270c7c60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:15.007174 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7e2c66cd-c466-4711-92b3-1c2f270c7c60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:15.017026 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e2c66cd-c466-4711-92b3-1c2f270c7c60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:15.017964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e2c66cd-c466-4711-92b3-1c2f270c7c60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:15.018955 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e2c66cd-c466-4711-92b3-1c2f270c7c60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:15.020338 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e2c66cd-c466-4711-92b3-1c2f270c7c60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:15.175490 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7e2c66cd-c466-4711-92b3-1c2f270c7c60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:15.183444 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7e2c66cd-c466-4711-92b3-1c2f270c7c60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:15.184958 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7e2c66cd-c466-4711-92b3-1c2f270c7c60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:15.186827 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7e2c66cd-c466-4711-92b3-1c2f270c7c60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.185670 Jul 18 17:02:15.187528 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 636/1267] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:14 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:02:16.207295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9a134337-0195-4141-839a-906a5af7e121 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:16.208045 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9a134337-0195-4141-839a-906a5af7e121 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:16.211010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=51 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:16.214704 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a134337-0195-4141-839a-906a5af7e121 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:16.220880 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a134337-0195-4141-839a-906a5af7e121 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:16.220880 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a134337-0195-4141-839a-906a5af7e121 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:16.220880 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a134337-0195-4141-839a-906a5af7e121 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:16.365046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9a134337-0195-4141-839a-906a5af7e121 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:16.373190 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9a134337-0195-4141-839a-906a5af7e121 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:16.380077 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9a134337-0195-4141-839a-906a5af7e121 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:16.380077 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9a134337-0195-4141-839a-906a5af7e121 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.173630 Jul 18 17:02:16.380077 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 632/1268] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:16 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:02:17.395179 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f907e3d8-1211-493b-b006-7a7310df096f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:17.395787 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f907e3d8-1211-493b-b006-7a7310df096f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:17.398369 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=56 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:17.403328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f907e3d8-1211-493b-b006-7a7310df096f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:17.403782 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f907e3d8-1211-493b-b006-7a7310df096f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:17.405129 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f907e3d8-1211-493b-b006-7a7310df096f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:17.405664 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f907e3d8-1211-493b-b006-7a7310df096f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:17.555449 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f907e3d8-1211-493b-b006-7a7310df096f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:17.564477 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f907e3d8-1211-493b-b006-7a7310df096f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:17.566012 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f907e3d8-1211-493b-b006-7a7310df096f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:17.567167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f907e3d8-1211-493b-b006-7a7310df096f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.176153 Jul 18 17:02:17.567722 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 637/1269] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:17 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:18.587145 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-594dd3ea-4ec4-495f-813c-dfdbabecaf60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:18.587745 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-594dd3ea-4ec4-495f-813c-dfdbabecaf60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:18.595130 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-594dd3ea-4ec4-495f-813c-dfdbabecaf60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.595583 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-594dd3ea-4ec4-495f-813c-dfdbabecaf60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.596350 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-594dd3ea-4ec4-495f-813c-dfdbabecaf60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.596792 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-594dd3ea-4ec4-495f-813c-dfdbabecaf60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.729811 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-594dd3ea-4ec4-495f-813c-dfdbabecaf60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:18.738605 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-594dd3ea-4ec4-495f-813c-dfdbabecaf60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:18.740124 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-594dd3ea-4ec4-495f-813c-dfdbabecaf60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:18.741331 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-594dd3ea-4ec4-495f-813c-dfdbabecaf60 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.158064 Jul 18 17:02:18.741913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 633/1270] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:18 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:19.759860 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e9f83063-7b5f-4ad7-b209-bd9825329606 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:19.760400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e9f83063-7b5f-4ad7-b209-bd9825329606 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:19.767354 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e9f83063-7b5f-4ad7-b209-bd9825329606 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:19.767824 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e9f83063-7b5f-4ad7-b209-bd9825329606 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:19.768610 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e9f83063-7b5f-4ad7-b209-bd9825329606 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:19.769076 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e9f83063-7b5f-4ad7-b209-bd9825329606 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:19.924721 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e9f83063-7b5f-4ad7-b209-bd9825329606 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:19.932918 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e9f83063-7b5f-4ad7-b209-bd9825329606 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:19.934437 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e9f83063-7b5f-4ad7-b209-bd9825329606 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:19.936371 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e9f83063-7b5f-4ad7-b209-bd9825329606 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.179876 Jul 18 17:02:19.937117 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 638/1271] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:19 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:20.955090 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ea716dc6-a7e9-44e0-8a43-33eafe16507d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:20.955762 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ea716dc6-a7e9-44e0-8a43-33eafe16507d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:20.962268 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea716dc6-a7e9-44e0-8a43-33eafe16507d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:20.962714 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea716dc6-a7e9-44e0-8a43-33eafe16507d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:20.963468 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea716dc6-a7e9-44e0-8a43-33eafe16507d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:20.963907 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea716dc6-a7e9-44e0-8a43-33eafe16507d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:21.104289 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ea716dc6-a7e9-44e0-8a43-33eafe16507d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:21.113450 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ea716dc6-a7e9-44e0-8a43-33eafe16507d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:21.114953 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ea716dc6-a7e9-44e0-8a43-33eafe16507d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:21.116118 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ea716dc6-a7e9-44e0-8a43-33eafe16507d tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.165149 Jul 18 17:02:21.116681 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 634/1272] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:20 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:22.135581 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a9868c19-4c85-42c3-9cc5-9038225fac8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:22.136135 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a9868c19-4c85-42c3-9cc5-9038225fac8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:22.145136 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9868c19-4c85-42c3-9cc5-9038225fac8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:22.145588 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9868c19-4c85-42c3-9cc5-9038225fac8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:22.148936 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9868c19-4c85-42c3-9cc5-9038225fac8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:22.149448 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9868c19-4c85-42c3-9cc5-9038225fac8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:22.290992 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a9868c19-4c85-42c3-9cc5-9038225fac8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:22.299915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a9868c19-4c85-42c3-9cc5-9038225fac8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:22.301445 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a9868c19-4c85-42c3-9cc5-9038225fac8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:22.302640 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a9868c19-4c85-42c3-9cc5-9038225fac8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1732 microversion: 2.20 time: 0.171113 Jul 18 17:02:22.303201 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 639/1273] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:22 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:23.331442 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-db5258c3-f4d9-4b3c-b241-811ed128afa4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:23.332087 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-db5258c3-f4d9-4b3c-b241-811ed128afa4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:23.340234 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-db5258c3-f4d9-4b3c-b241-811ed128afa4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:23.340683 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-db5258c3-f4d9-4b3c-b241-811ed128afa4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:23.341504 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-db5258c3-f4d9-4b3c-b241-811ed128afa4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:23.341937 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-db5258c3-f4d9-4b3c-b241-811ed128afa4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:23.483778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-db5258c3-f4d9-4b3c-b241-811ed128afa4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:23.492547 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-db5258c3-f4d9-4b3c-b241-811ed128afa4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:23.494086 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-db5258c3-f4d9-4b3c-b241-811ed128afa4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:23.495278 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-db5258c3-f4d9-4b3c-b241-811ed128afa4 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1719 microversion: 2.20 time: 0.168587 Jul 18 17:02:23.495870 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 635/1274] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:02:23 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:02:31.531365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-22c24ec8-36f9-44c9-a5aa-b0dab706ff66 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:31.531989 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-22c24ec8-36f9-44c9-a5aa-b0dab706ff66 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:31.548394 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22c24ec8-36f9-44c9-a5aa-b0dab706ff66 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:31.556191 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22c24ec8-36f9-44c9-a5aa-b0dab706ff66 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:31.556191 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22c24ec8-36f9-44c9-a5aa-b0dab706ff66 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:31.556191 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22c24ec8-36f9-44c9-a5aa-b0dab706ff66 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:31.574482 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-22c24ec8-36f9-44c9-a5aa-b0dab706ff66 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/ips" status: 200 len: 146 microversion: 2.1 time: 0.047942 Jul 18 17:02:31.575061 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 640/1275] 10.222.0.76 () {58 vars in 1247 bytes} [Mon Jul 18 17:02:31 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/ips => generated 146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:34.382880 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-aa3c42ee-6423-4289-a300-fd1c78800f03 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30d0bde5-6056-4299-b31b-e8c5ccd14502"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:02:34.383937 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-aa3c42ee-6423-4289-a300-fd1c78800f03 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:34.386451 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=7 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:34.387133 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=71 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:34.392038 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aa3c42ee-6423-4289-a300-fd1c78800f03 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:34.392505 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aa3c42ee-6423-4289-a300-fd1c78800f03 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:34.393307 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aa3c42ee-6423-4289-a300-fd1c78800f03 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:34.393754 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aa3c42ee-6423-4289-a300-fd1c78800f03 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:35.237127 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-aa3c42ee-6423-4289-a300-fd1c78800f03 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "POST /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857902 Jul 18 17:02:35.237870 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 636/1276] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 17:02:34 2022] POST /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:43.796648 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9e69711f-61c9-49f8-b11d-a4f200a286e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:43.798213 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9e69711f-61c9-49f8-b11d-a4f200a286e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:43.800808 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=7 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:43.801531 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=83 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:43.806574 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9e69711f-61c9-49f8-b11d-a4f200a286e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:43.807075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9e69711f-61c9-49f8-b11d-a4f200a286e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:43.807936 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9e69711f-61c9-49f8-b11d-a4f200a286e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:43.808428 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9e69711f-61c9-49f8-b11d-a4f200a286e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:43.838603 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9e69711f-61c9-49f8-b11d-a4f200a286e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045908 Jul 18 17:02:43.839167 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 641/1277] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:43 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:43.850373 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-afcbf837-e900-41ac-aa43-576aa4719bee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:43.850955 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-afcbf837-e900-41ac-aa43-576aa4719bee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:43.857887 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-afcbf837-e900-41ac-aa43-576aa4719bee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:43.858455 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-afcbf837-e900-41ac-aa43-576aa4719bee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:43.859278 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-afcbf837-e900-41ac-aa43-576aa4719bee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:43.859839 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-afcbf837-e900-41ac-aa43-576aa4719bee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:43.889586 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-afcbf837-e900-41ac-aa43-576aa4719bee tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments/30d0bde5-6056-4299-b31b-e8c5ccd14502" status: 200 len: 194 microversion: 2.1 time: 0.043477 Jul 18 17:02:43.890168 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 637/1278] 10.222.0.76 () {58 vars in 1412 bytes} [Mon Jul 18 17:02:43 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments/30d0bde5-6056-4299-b31b-e8c5ccd14502 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:46.590501 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e50ebd9d-cd6f-4995-8696-84e354fe2dbc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a33ea221-8180-4594-8b74-6f0cc6760407"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:02:46.591623 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e50ebd9d-cd6f-4995-8696-84e354fe2dbc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:46.599191 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e50ebd9d-cd6f-4995-8696-84e354fe2dbc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:46.599631 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e50ebd9d-cd6f-4995-8696-84e354fe2dbc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:46.600398 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e50ebd9d-cd6f-4995-8696-84e354fe2dbc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:46.600833 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e50ebd9d-cd6f-4995-8696-84e354fe2dbc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:47.282851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e50ebd9d-cd6f-4995-8696-84e354fe2dbc tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "POST /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.696460 Jul 18 17:02:47.283392 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 642/1279] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 17:02:46 2022] POST /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments => generated 194 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:55.845565 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-74197649-001c-4336-8cee-00caa7816d80 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:55.846565 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-74197649-001c-4336-8cee-00caa7816d80 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:55.849188 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=4 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:55.849830 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:55.854599 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-74197649-001c-4336-8cee-00caa7816d80 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:55.855050 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-74197649-001c-4336-8cee-00caa7816d80 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:55.855823 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-74197649-001c-4336-8cee-00caa7816d80 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:55.856260 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-74197649-001c-4336-8cee-00caa7816d80 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:55.887046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-74197649-001c-4336-8cee-00caa7816d80 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046141 Jul 18 17:02:55.887828 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 638/1280] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:55 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:56.032444 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9ec2c76b-45e4-47c7-ba4c-566bf63ba4ad tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:56.033045 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9ec2c76b-45e4-47c7-ba4c-566bf63ba4ad tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:56.039417 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ec2c76b-45e4-47c7-ba4c-566bf63ba4ad tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:56.039857 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ec2c76b-45e4-47c7-ba4c-566bf63ba4ad tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:56.040620 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ec2c76b-45e4-47c7-ba4c-566bf63ba4ad tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:56.041085 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ec2c76b-45e4-47c7-ba4c-566bf63ba4ad tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:56.070089 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9ec2c76b-45e4-47c7-ba4c-566bf63ba4ad tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments/30d0bde5-6056-4299-b31b-e8c5ccd14502" status: 200 len: 194 microversion: 2.1 time: 0.043268 Jul 18 17:02:56.070691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 643/1281] 10.222.0.76 () {58 vars in 1412 bytes} [Mon Jul 18 17:02:56 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments/30d0bde5-6056-4299-b31b-e8c5ccd14502 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:56.081880 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9777eeb6-400a-4e6c-9b4d-3b3e3f4223e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:56.083159 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9777eeb6-400a-4e6c-9b4d-3b3e3f4223e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:56.088807 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9777eeb6-400a-4e6c-9b4d-3b3e3f4223e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:56.089282 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9777eeb6-400a-4e6c-9b4d-3b3e3f4223e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:56.090054 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9777eeb6-400a-4e6c-9b4d-3b3e3f4223e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:56.090494 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9777eeb6-400a-4e6c-9b4d-3b3e3f4223e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:56.174962 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-9777eeb6-400a-4e6c-9b4d-3b3e3f4223e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lazy-loading 'services' on Instance uuid 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:02:56.391867 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9777eeb6-400a-4e6c-9b4d-3b3e3f4223e4 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "DELETE /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments/30d0bde5-6056-4299-b31b-e8c5ccd14502" status: 202 len: 0 microversion: 2.1 time: 0.315266 Jul 18 17:02:56.392388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 639/1282] 10.222.0.76 () {58 vars in 1415 bytes} [Mon Jul 18 17:02:56 2022] DELETE /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments/30d0bde5-6056-4299-b31b-e8c5ccd14502 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:02:58.555179 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-33dff166-a8b6-4070-ba69-7bfa04b53cdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:58.555736 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-33dff166-a8b6-4070-ba69-7bfa04b53cdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:58.562836 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-33dff166-a8b6-4070-ba69-7bfa04b53cdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:58.563297 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-33dff166-a8b6-4070-ba69-7bfa04b53cdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:58.564075 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-33dff166-a8b6-4070-ba69-7bfa04b53cdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:58.564520 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-33dff166-a8b6-4070-ba69-7bfa04b53cdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:58.595001 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-33dff166-a8b6-4070-ba69-7bfa04b53cdb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments/a33ea221-8180-4594-8b74-6f0cc6760407" status: 200 len: 194 microversion: 2.1 time: 0.043724 Jul 18 17:02:58.595633 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 644/1283] 10.222.0.76 () {58 vars in 1412 bytes} [Mon Jul 18 17:02:58 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments/a33ea221-8180-4594-8b74-6f0cc6760407 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:58.607219 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-687702a8-8094-43c4-9db3-89e5b4be0a28 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:58.607788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-687702a8-8094-43c4-9db3-89e5b4be0a28 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:58.614459 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-687702a8-8094-43c4-9db3-89e5b4be0a28 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:58.614903 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-687702a8-8094-43c4-9db3-89e5b4be0a28 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:58.615660 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-687702a8-8094-43c4-9db3-89e5b4be0a28 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:58.616101 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-687702a8-8094-43c4-9db3-89e5b4be0a28 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:58.698674 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-687702a8-8094-43c4-9db3-89e5b4be0a28 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lazy-loading 'services' on Instance uuid 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:02:58.889313 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-687702a8-8094-43c4-9db3-89e5b4be0a28 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "DELETE /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments/a33ea221-8180-4594-8b74-6f0cc6760407" status: 202 len: 0 microversion: 2.1 time: 0.286423 Jul 18 17:02:58.889913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 640/1284] 10.222.0.76 () {58 vars in 1415 bytes} [Mon Jul 18 17:02:58 2022] DELETE /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments/a33ea221-8180-4594-8b74-6f0cc6760407 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:03:01.105285 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b704bbee-fb26-49bd-954f-43a97b14e571 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:01.106267 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b704bbee-fb26-49bd-954f-43a97b14e571 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:01.113111 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b704bbee-fb26-49bd-954f-43a97b14e571 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:01.113570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b704bbee-fb26-49bd-954f-43a97b14e571 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:01.114347 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b704bbee-fb26-49bd-954f-43a97b14e571 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:01.114792 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b704bbee-fb26-49bd-954f-43a97b14e571 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:01.143665 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b704bbee-fb26-49bd-954f-43a97b14e571 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042327 Jul 18 17:03:01.144215 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 645/1285] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:01 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 17:03:01.250623 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7d9c21de-139b-414a-ac3a-716485a1e8fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:01.251637 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7d9c21de-139b-414a-ac3a-716485a1e8fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:01.258384 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d9c21de-139b-414a-ac3a-716485a1e8fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:01.258784 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d9c21de-139b-414a-ac3a-716485a1e8fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:01.259578 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d9c21de-139b-414a-ac3a-716485a1e8fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:01.260023 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d9c21de-139b-414a-ac3a-716485a1e8fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:01.288933 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7d9c21de-139b-414a-ac3a-716485a1e8fe tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043184 Jul 18 17:03:01.289524 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 641/1286] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:01 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 17:03:01.346272 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6ff0cfb0-85a5-4180-9dee-922189d6aba8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:01.346801 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6ff0cfb0-85a5-4180-9dee-922189d6aba8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:01.352801 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ff0cfb0-85a5-4180-9dee-922189d6aba8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:01.353305 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ff0cfb0-85a5-4180-9dee-922189d6aba8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:01.354063 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ff0cfb0-85a5-4180-9dee-922189d6aba8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:01.354505 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ff0cfb0-85a5-4180-9dee-922189d6aba8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:01.379704 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6ff0cfb0-85a5-4180-9dee-922189d6aba8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:03:01.677551 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6ff0cfb0-85a5-4180-9dee-922189d6aba8 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "DELETE /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 204 len: 0 microversion: 2.1 time: 0.335002 Jul 18 17:03:01.678203 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 646/1287] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:03:01 2022] DELETE /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:03:01.686763 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-981980d6-1fd3-41b0-b165-0e3425420259 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:01.687984 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-981980d6-1fd3-41b0-b165-0e3425420259 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:01.694268 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-981980d6-1fd3-41b0-b165-0e3425420259 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:01.694718 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-981980d6-1fd3-41b0-b165-0e3425420259 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:01.695472 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-981980d6-1fd3-41b0-b165-0e3425420259 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:01.695911 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-981980d6-1fd3-41b0-b165-0e3425420259 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:01.847090 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-981980d6-1fd3-41b0-b165-0e3425420259 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:01.854875 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-981980d6-1fd3-41b0-b165-0e3425420259 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1673 microversion: 2.1 time: 0.172138 Jul 18 17:03:01.855383 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 642/1288] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:01 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:02.873024 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4948c5c6-45cf-413a-a896-3b154dca5727 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:02.873737 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4948c5c6-45cf-413a-a896-3b154dca5727 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:02.880467 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4948c5c6-45cf-413a-a896-3b154dca5727 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:02.880923 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4948c5c6-45cf-413a-a896-3b154dca5727 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:02.881732 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4948c5c6-45cf-413a-a896-3b154dca5727 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:02.882174 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4948c5c6-45cf-413a-a896-3b154dca5727 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:03.019559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4948c5c6-45cf-413a-a896-3b154dca5727 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:03.027441 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4948c5c6-45cf-413a-a896-3b154dca5727 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1673 microversion: 2.1 time: 0.159145 Jul 18 17:03:03.028023 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 647/1289] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:02 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:04.044537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-41f0d3a5-78d6-4d86-9566-5ffa1d50c255 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:04.045225 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-41f0d3a5-78d6-4d86-9566-5ffa1d50c255 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:04.052673 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41f0d3a5-78d6-4d86-9566-5ffa1d50c255 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:04.053164 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41f0d3a5-78d6-4d86-9566-5ffa1d50c255 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:04.053949 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41f0d3a5-78d6-4d86-9566-5ffa1d50c255 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:04.054393 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41f0d3a5-78d6-4d86-9566-5ffa1d50c255 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:04.194909 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-41f0d3a5-78d6-4d86-9566-5ffa1d50c255 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:04.202590 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-41f0d3a5-78d6-4d86-9566-5ffa1d50c255 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1673 microversion: 2.1 time: 0.161969 Jul 18 17:03:04.203189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 643/1290] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:04 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:05.221213 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fa5fe7fe-f474-4241-a084-8c2d9bad17a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:05.221873 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fa5fe7fe-f474-4241-a084-8c2d9bad17a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:05.228798 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa5fe7fe-f474-4241-a084-8c2d9bad17a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:05.229282 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa5fe7fe-f474-4241-a084-8c2d9bad17a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:05.230065 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa5fe7fe-f474-4241-a084-8c2d9bad17a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:05.230499 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa5fe7fe-f474-4241-a084-8c2d9bad17a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:05.356588 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fa5fe7fe-f474-4241-a084-8c2d9bad17a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:05.365269 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fa5fe7fe-f474-4241-a084-8c2d9bad17a9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1606 microversion: 2.1 time: 0.148657 Jul 18 17:03:05.365920 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 648/1291] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:05 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1606 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:03:05.679370 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-812fae7c-1f91-4205-b695-e358913c5195 req-a277621c-16d1-4585-8475-dcd3a4fe4b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "713eeca4-97c2-49c7-a6e6-a438f9b5c9d4", "name": "network-vif-deleted", "tag": "e8b1fd5e-f836-49aa-8495-9b0aee05d3f4"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:03:05.688090 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-812fae7c-1f91-4205-b695-e358913c5195 req-a277621c-16d1-4585-8475-dcd3a4fe4b9f service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:05.696016 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-812fae7c-1f91-4205-b695-e358913c5195 req-a277621c-16d1-4585-8475-dcd3a4fe4b9f service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:05.701828 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-812fae7c-1f91-4205-b695-e358913c5195 req-a277621c-16d1-4585-8475-dcd3a4fe4b9f service nova] Creating event network-vif-deleted:e8b1fd5e-f836-49aa-8495-9b0aee05d3f4 for instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 on hv-cinder-83754 Jul 18 17:03:05.707854 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-812fae7c-1f91-4205-b695-e358913c5195 req-a277621c-16d1-4585-8475-dcd3a4fe4b9f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233352 Jul 18 17:03:05.708455 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 644/1292] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:06.383225 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bab4fcf9-a42f-4136-9495-a6e5c33c2023 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:06.384817 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bab4fcf9-a42f-4136-9495-a6e5c33c2023 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:06.393226 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab4fcf9-a42f-4136-9495-a6e5c33c2023 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:06.394717 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab4fcf9-a42f-4136-9495-a6e5c33c2023 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:06.394717 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab4fcf9-a42f-4136-9495-a6e5c33c2023 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:06.395091 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab4fcf9-a42f-4136-9495-a6e5c33c2023 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:06.435541 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab4fcf9-a42f-4136-9495-a6e5c33c2023 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:06.436511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab4fcf9-a42f-4136-9495-a6e5c33c2023 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:06.436511 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-bab4fcf9-a42f-4136-9495-a6e5c33c2023 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lazy-loading 'fault' on Instance uuid 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:03:06.482306 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-bab4fcf9-a42f-4136-9495-a6e5c33c2023 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b98162f0ce8462fa1a20871ab1a6560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:06.493805 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bab4fcf9-a42f-4136-9495-a6e5c33c2023 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 200 len: 1327 microversion: 2.1 time: 0.114450 Jul 18 17:03:06.494676 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 649/1293] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:06 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:07.517634 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a5ade218-add3-44c9-a509-f88dfb76ac49 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:07.518322 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a5ade218-add3-44c9-a509-f88dfb76ac49 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:07.524741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a5ade218-add3-44c9-a509-f88dfb76ac49 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:07.525226 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a5ade218-add3-44c9-a509-f88dfb76ac49 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:07.525994 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a5ade218-add3-44c9-a509-f88dfb76ac49 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:07.526446 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a5ade218-add3-44c9-a509-f88dfb76ac49 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:07.540487 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-a5ade218-add3-44c9-a509-f88dfb76ac49 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] HTTP exception thrown: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a5ade218-add3-44c9-a509-f88dfb76ac49 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Request method failure captured: Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 HTTP/1.1 Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y_rIc84oOOembKBLVr2GgL_nE5Fr1mHgNYcVf10vYnB7uFrNv9bctz44zvS2aZow9NPqnSx0qBm-BQp9z9G4LFWCCdOOupTTM1R1v5cfK-RRp2_3Ats8hPUHLWpW0aYaB34ircLMkjRX654ZLEInfTawo0DRnhy4xNU46zJ7AIxDYQ Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: d713a57b50cf4fe3b0fc1bd63cb761fd Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:03:07.542249 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:03:07.543921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:03:07.543921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:07.543921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: d713a57b50cf4fe3b0fc1bd63cb761fd Jul 18 17:03:07.543921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:07.543921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeTestJSON-608912424-project Jul 18 17:03:07.543921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:03:07.543921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:03:07.543921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 7b98162f0ce8462fa1a20871ab1a6560 Jul 18 17:03:07.543921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeTestJSON-608912424-project Jul 18 17:03:07.543921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:03:07.543921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:07.543921 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '713eeca4-97c2-49c7-a6e6-a438f9b5c9d4'} Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:03:07.544779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:07.546391 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:07.547920 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a5ade218-add3-44c9-a509-f88dfb76ac49 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Returning 404 to user: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:03:07.547920 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a5ade218-add3-44c9-a509-f88dfb76ac49 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 404 len: 111 microversion: 2.1 time: 0.031674 Jul 18 17:03:07.547920 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 645/1294] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:07 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:03:07.552593 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e5154c84-c4ed-42ca-951d-b05e64fe826c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '.version_select at 0x7f4af16e0b80>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:07.644646 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e5154c84-c4ed-42ca-951d-b05e64fe826c tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-785173414" status: 202 len: 0 microversion: 2.1 time: 0.095756 Jul 18 17:03:07.645260 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 650/1295] 10.222.0.76 () {58 vars in 1217 bytes} [Mon Jul 18 17:03:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-785173414 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:03:11.144060 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8d6adc58-d781-4e82-b803-f2763e1473e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:11.144694 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8d6adc58-d781-4e82-b803-f2763e1473e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:11.151138 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d6adc58-d781-4e82-b803-f2763e1473e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:11.151589 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d6adc58-d781-4e82-b803-f2763e1473e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:11.152364 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d6adc58-d781-4e82-b803-f2763e1473e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:11.152786 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d6adc58-d781-4e82-b803-f2763e1473e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:11.167401 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-8d6adc58-d781-4e82-b803-f2763e1473e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] HTTP exception thrown: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8d6adc58-d781-4e82-b803-f2763e1473e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Request method failure captured: Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 HTTP/1.1 Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y_rIc84oOOembKBLVr2GgL_nE5Fr1mHgNYcVf10vYnB7uFrNv9bctz44zvS2aZow9NPqnSx0qBm-BQp9z9G4LFWCCdOOupTTM1R1v5cfK-RRp2_3Ats8hPUHLWpW0aYaB34ircLMkjRX654ZLEInfTawo0DRnhy4xNU46zJ7AIxDYQ Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: d713a57b50cf4fe3b0fc1bd63cb761fd Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:03:11.168947 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:03:11.170566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:03:11.170566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:11.170566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: d713a57b50cf4fe3b0fc1bd63cb761fd Jul 18 17:03:11.170566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:11.170566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeTestJSON-608912424-project Jul 18 17:03:11.170566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:03:11.170566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:03:11.170566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 7b98162f0ce8462fa1a20871ab1a6560 Jul 18 17:03:11.170566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeTestJSON-608912424-project Jul 18 17:03:11.170566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:03:11.170566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:11.170566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '713eeca4-97c2-49c7-a6e6-a438f9b5c9d4'} Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:03:11.173764 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:11.175906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:11.177432 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8d6adc58-d781-4e82-b803-f2763e1473e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Returning 404 to user: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:03:11.177432 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8d6adc58-d781-4e82-b803-f2763e1473e9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "DELETE /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 404 len: 111 microversion: 2.1 time: 0.031306 Jul 18 17:03:11.177432 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 646/1296] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:03:11 2022] DELETE /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:03:11.179988 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d6acbd9b-e62b-4a59-b58f-8bc4dd5cc2eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:11.180597 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d6acbd9b-e62b-4a59-b58f-8bc4dd5cc2eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:11.187317 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6acbd9b-e62b-4a59-b58f-8bc4dd5cc2eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:11.187771 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6acbd9b-e62b-4a59-b58f-8bc4dd5cc2eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:11.188604 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6acbd9b-e62b-4a59-b58f-8bc4dd5cc2eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:11.189107 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6acbd9b-e62b-4a59-b58f-8bc4dd5cc2eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:11.204541 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-d6acbd9b-e62b-4a59-b58f-8bc4dd5cc2eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] HTTP exception thrown: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d6acbd9b-e62b-4a59-b58f-8bc4dd5cc2eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Request method failure captured: Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 HTTP/1.1 Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y_rIc84oOOembKBLVr2GgL_nE5Fr1mHgNYcVf10vYnB7uFrNv9bctz44zvS2aZow9NPqnSx0qBm-BQp9z9G4LFWCCdOOupTTM1R1v5cfK-RRp2_3Ats8hPUHLWpW0aYaB34ircLMkjRX654ZLEInfTawo0DRnhy4xNU46zJ7AIxDYQ Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: d713a57b50cf4fe3b0fc1bd63cb761fd Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 17:03:11.206216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 17:03:11.209475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:03:11.209475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:11.209475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: d713a57b50cf4fe3b0fc1bd63cb761fd Jul 18 17:03:11.209475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:11.209475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeTestJSON-608912424-project Jul 18 17:03:11.209475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 17:03:11.209475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 17:03:11.209475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 7b98162f0ce8462fa1a20871ab1a6560 Jul 18 17:03:11.209475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeTestJSON-608912424-project Jul 18 17:03:11.209475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 17:03:11.209475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:11.209475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '713eeca4-97c2-49c7-a6e6-a438f9b5c9d4'} Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:03:11.211210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. Jul 18 17:03:11.213942 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:11.216915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d6acbd9b-e62b-4a59-b58f-8bc4dd5cc2eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Returning 404 to user: Instance 713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:03:11.216915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d6acbd9b-e62b-4a59-b58f-8bc4dd5cc2eb tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4" status: 404 len: 111 microversion: 2.1 time: 0.032170 Jul 18 17:03:11.216915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 651/1297] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:11 2022] GET /compute/v2.1/servers/713eeca4-97c2-49c7-a6e6-a438f9b5c9d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:03:12.482709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1c6e09ca-5db4-45c5-9bbb-775d1346d873 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:12.483286 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1c6e09ca-5db4-45c5-9bbb-775d1346d873 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:12.491532 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1c6e09ca-5db4-45c5-9bbb-775d1346d873 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:12.491883 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1c6e09ca-5db4-45c5-9bbb-775d1346d873 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:12.492663 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1c6e09ca-5db4-45c5-9bbb-775d1346d873 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:12.493146 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1c6e09ca-5db4-45c5-9bbb-775d1346d873 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:12.507407 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-1c6e09ca-5db4-45c5-9bbb-775d1346d873 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] HTTP exception thrown: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1c6e09ca-5db4-45c5-9bbb-775d1346d873 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Request method failure captured: Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 HTTP/1.1 Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y_rIc84oOOembKBLVr2GgL_nE5Fr1mHgNYcVf10vYnB7uFrNv9bctz44zvS2aZow9NPqnSx0qBm-BQp9z9G4LFWCCdOOupTTM1R1v5cfK-RRp2_3Ats8hPUHLWpW0aYaB34ircLMkjRX654ZLEInfTawo0DRnhy4xNU46zJ7AIxDYQ Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: d713a57b50cf4fe3b0fc1bd63cb761fd Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:03:12.508948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:03:12.510603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:03:12.510603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:12.510603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: d713a57b50cf4fe3b0fc1bd63cb761fd Jul 18 17:03:12.510603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:12.510603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeTestJSON-608912424-project Jul 18 17:03:12.510603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:03:12.510603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:03:12.510603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 7b98162f0ce8462fa1a20871ab1a6560 Jul 18 17:03:12.510603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeTestJSON-608912424-project Jul 18 17:03:12.510603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:03:12.510603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:03:12.510603 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '2f8d5ca4-1bea-450f-8560-c07717d110e6'} Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:03:12.511443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:03:12.512915 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:12.514448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1c6e09ca-5db4-45c5-9bbb-775d1346d873 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Returning 404 to user: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:03:12.514448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1c6e09ca-5db4-45c5-9bbb-775d1346d873 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 404 len: 111 microversion: 2.1 time: 0.031666 Jul 18 17:03:12.514448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 647/1298] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:03:12 2022] DELETE /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:03:12.519210 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9336b6ec-a18f-41f7-9f41-77a2f0889fd9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:12.519868 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9336b6ec-a18f-41f7-9f41-77a2f0889fd9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] [instance: 2f8d5ca4-1bea-450f-8560-c07717d110e6] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:12.526747 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9336b6ec-a18f-41f7-9f41-77a2f0889fd9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:12.527204 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9336b6ec-a18f-41f7-9f41-77a2f0889fd9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:12.527980 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9336b6ec-a18f-41f7-9f41-77a2f0889fd9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:12.528421 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9336b6ec-a18f-41f7-9f41-77a2f0889fd9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:12.545470 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-9336b6ec-a18f-41f7-9f41-77a2f0889fd9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] HTTP exception thrown: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9336b6ec-a18f-41f7-9f41-77a2f0889fd9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Request method failure captured: Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 HTTP/1.1 Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y_rIc84oOOembKBLVr2GgL_nE5Fr1mHgNYcVf10vYnB7uFrNv9bctz44zvS2aZow9NPqnSx0qBm-BQp9z9G4LFWCCdOOupTTM1R1v5cfK-RRp2_3Ats8hPUHLWpW0aYaB34ircLMkjRX654ZLEInfTawo0DRnhy4xNU46zJ7AIxDYQ Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: d713a57b50cf4fe3b0fc1bd63cb761fd Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 17:03:12.547796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 17:03:12.549415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d713a57b50cf4fe3b0fc1bd63cb761fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:03:12.549415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:12.549415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: d713a57b50cf4fe3b0fc1bd63cb761fd Jul 18 17:03:12.549415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-608912424 Jul 18 17:03:12.549415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeTestJSON-608912424-project Jul 18 17:03:12.549415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 17:03:12.549415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 17:03:12.549415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 7b98162f0ce8462fa1a20871ab1a6560 Jul 18 17:03:12.549415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeTestJSON-608912424-project Jul 18 17:03:12.549415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 17:03:12.549415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:03:12.549415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '2f8d5ca4-1bea-450f-8560-c07717d110e6'} Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:03:12.550294 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. Jul 18 17:03:12.551870 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:12.553327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9336b6ec-a18f-41f7-9f41-77a2f0889fd9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] Returning 404 to user: Instance 2f8d5ca4-1bea-450f-8560-c07717d110e6 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:03:12.553327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9336b6ec-a18f-41f7-9f41-77a2f0889fd9 tempest-AttachVolumeTestJSON-608912424 tempest-AttachVolumeTestJSON-608912424-project] 10.222.0.76 "GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6" status: 404 len: 111 microversion: 2.1 time: 0.034266 Jul 18 17:03:12.553327 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 652/1299] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:12 2022] GET /compute/v2.1/servers/2f8d5ca4-1bea-450f-8560-c07717d110e6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:03:17.672253 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:03:17.672987 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Mon Jul 18 17:03:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:03:21.547956 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c418c98a-8159-47da-91fb-10d3c31a2311 tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] Calling method '.version_select at 0x7f4af5e945e0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:21.597132 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c418c98a-8159-47da-91fb-10d3c31a2311 tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/774f2968-bb86-493f-aecf-52d09b7fb76a" status: 200 len: 350 microversion: 2.1 time: 0.053019 Jul 18 17:03:21.597722 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 648/1300] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 17:03:21 2022] GET /compute/v2.1/os-volumes/774f2968-bb86-493f-aecf-52d09b7fb76a => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:23.191296 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dd184543-619a-4670-b915-6b5822239d93 tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] Calling method '.version_select at 0x7f4af16e0b80>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:23.198141 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:23.198904 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:23.243349 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dd184543-619a-4670-b915-6b5822239d93 tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/7bd0d47d-14df-470c-94d6-f9e3a831fc8d" status: 200 len: 351 microversion: 2.1 time: 0.056191 Jul 18 17:03:23.243913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 653/1301] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 17:03:23 2022] GET /compute/v2.1/os-volumes/7bd0d47d-14df-470c-94d6-f9e3a831fc8d => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:25.981055 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=20 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:25.981835 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:25.988355 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9a4fdcb8-5134-45ad-b807-1731e79aaf7c tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] Calling method '.version_select at 0x7f4af5e94700>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:26.039572 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9a4fdcb8-5134-45ad-b807-1731e79aaf7c tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/085ec36e-430f-4074-84d2-aaa3a93f36af" status: 200 len: 350 microversion: 2.1 time: 0.059117 Jul 18 17:03:26.040233 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 649/1302] 10.222.0.76 () {58 vars in 1244 bytes} [Mon Jul 18 17:03:25 2022] GET /compute/v2.1/os-volumes/085ec36e-430f-4074-84d2-aaa3a93f36af => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:26.052810 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c08a6310-fbd3-446f-8d94-ef60ac32de61 tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] Calling method '.version_select at 0x7f4af159c8b0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:26.141468 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c08a6310-fbd3-446f-8d94-ef60ac32de61 tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.093835 Jul 18 17:03:26.142073 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 654/1303] 10.222.0.76 () {58 vars in 1133 bytes} [Mon Jul 18 17:03:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:26.156493 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-38fa7739-1106-4cef-b5f3-e322203ec03f tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] Calling method '.version_select at 0x7f4af208af70>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:26.239746 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-38fa7739-1106-4cef-b5f3-e322203ec03f tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087549 Jul 18 17:03:26.240392 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 650/1304] 10.222.0.76 () {58 vars in 1148 bytes} [Mon Jul 18 17:03:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:26.252832 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1b889d08-ef1e-4a94-aea4-5510d38a4946 tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] Calling method '.version_select at 0x7f4af1960280>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:26.337476 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1b889d08-ef1e-4a94-aea4-5510d38a4946 tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089025 Jul 18 17:03:26.338041 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 655/1305] 10.222.0.76 () {58 vars in 1133 bytes} [Mon Jul 18 17:03:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:26.349450 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b74e2882-b483-481e-a392-afa6dfc5a665 tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] Calling method '.version_select at 0x7f4af5e89550>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:26.453991 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b74e2882-b483-481e-a392-afa6dfc5a665 tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.108323 Jul 18 17:03:26.454555 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 651/1306] 10.222.0.76 () {58 vars in 1166 bytes} [Mon Jul 18 17:03:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:26.470340 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-019066f4-866d-4065-b960-4c36c81a0efe tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] Calling method '.version_select at 0x7f4af1960dc0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:26.577545 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-019066f4-866d-4065-b960-4c36c81a0efe tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.113182 Jul 18 17:03:26.578153 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 656/1307] 10.222.0.76 () {58 vars in 1169 bytes} [Mon Jul 18 17:03:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:26.591468 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9eaef940-e259-4f2c-8d1c-98f90a63a1f6 tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] Calling method '.version_select at 0x7f4af5e9d700>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:26.689626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9eaef940-e259-4f2c-8d1c-98f90a63a1f6 tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.102000 Jul 18 17:03:26.690835 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 652/1308] 10.222.0.76 () {58 vars in 1154 bytes} [Mon Jul 18 17:03:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:26.702517 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c7f2e7c7-9c7e-4866-a574-f4cef89d38fd tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] Calling method '.version_select at 0x7f4af19381f0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:26.807141 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c7f2e7c7-9c7e-4866-a574-f4cef89d38fd tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.106749 Jul 18 17:03:26.807141 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 657/1309] 10.222.0.76 () {58 vars in 1187 bytes} [Mon Jul 18 17:03:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:26.819173 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4759f169-a863-428b-9fd8-711a6362ad4e tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] Calling method '.version_select at 0x7f4af5e9da60>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:26.910063 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4759f169-a863-428b-9fd8-711a6362ad4e tempest-VolumesTestJSON-734643330 tempest-VolumesTestJSON-734643330-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.095496 Jul 18 17:03:26.910643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 653/1310] 10.222.0.76 () {58 vars in 1154 bytes} [Mon Jul 18 17:03:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:30.740676 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e41c2201-0485-40fa-9f45-add088037472 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:30.742312 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e41c2201-0485-40fa-9f45-add088037472 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:30.749637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e41c2201-0485-40fa-9f45-add088037472 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:30.752650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e41c2201-0485-40fa-9f45-add088037472 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:30.752650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e41c2201-0485-40fa-9f45-add088037472 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:30.752650 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e41c2201-0485-40fa-9f45-add088037472 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:30.784962 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e41c2201-0485-40fa-9f45-add088037472 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048719 Jul 18 17:03:30.793052 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 658/1311] 10.222.0.76 () {60 vars in 1342 bytes} [Mon Jul 18 17:03:30 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:30.854920 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-83129d21-6feb-40aa-aabe-2744206ffdbf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:30.855507 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-83129d21-6feb-40aa-aabe-2744206ffdbf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:30.862308 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-83129d21-6feb-40aa-aabe-2744206ffdbf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:30.862789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-83129d21-6feb-40aa-aabe-2744206ffdbf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:30.863577 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-83129d21-6feb-40aa-aabe-2744206ffdbf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:30.864022 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-83129d21-6feb-40aa-aabe-2744206ffdbf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:30.892315 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-83129d21-6feb-40aa-aabe-2744206ffdbf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:03:31.335620 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-83129d21-6feb-40aa-aabe-2744206ffdbf tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 204 len: 0 microversion: 2.20 time: 0.486250 Jul 18 17:03:31.336293 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 654/1312] 10.222.0.76 () {60 vars in 1279 bytes} [Mon Jul 18 17:03:30 2022] DELETE /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 17:03:31.351955 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-456c85c6-23d1-4295-9dee-88914c531137 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:31.352565 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-456c85c6-23d1-4295-9dee-88914c531137 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:31.358967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-456c85c6-23d1-4295-9dee-88914c531137 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:31.359457 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-456c85c6-23d1-4295-9dee-88914c531137 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:31.360568 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-456c85c6-23d1-4295-9dee-88914c531137 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:31.361066 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-456c85c6-23d1-4295-9dee-88914c531137 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:31.498065 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-456c85c6-23d1-4295-9dee-88914c531137 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:31.506478 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-456c85c6-23d1-4295-9dee-88914c531137 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:31.508717 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-456c85c6-23d1-4295-9dee-88914c531137 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:31.509796 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-456c85c6-23d1-4295-9dee-88914c531137 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.162106 Jul 18 17:03:31.510421 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 659/1313] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:03:31 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:03:32.530361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-aed3b0fe-c599-4d56-8712-7ef3e17de862 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:32.531092 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-aed3b0fe-c599-4d56-8712-7ef3e17de862 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:32.537641 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aed3b0fe-c599-4d56-8712-7ef3e17de862 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:32.538085 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aed3b0fe-c599-4d56-8712-7ef3e17de862 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:32.538883 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aed3b0fe-c599-4d56-8712-7ef3e17de862 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:32.539527 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aed3b0fe-c599-4d56-8712-7ef3e17de862 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:32.681429 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-aed3b0fe-c599-4d56-8712-7ef3e17de862 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:32.690013 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-aed3b0fe-c599-4d56-8712-7ef3e17de862 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:32.691626 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-aed3b0fe-c599-4d56-8712-7ef3e17de862 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:32.692677 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-aed3b0fe-c599-4d56-8712-7ef3e17de862 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.166522 Jul 18 17:03:32.702948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 655/1314] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:03:32 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:03:33.719026 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fb94f47e-9ec5-44eb-b4c1-33f479a8c765 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:33.720256 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fb94f47e-9ec5-44eb-b4c1-33f479a8c765 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:33.728004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb94f47e-9ec5-44eb-b4c1-33f479a8c765 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:33.728731 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb94f47e-9ec5-44eb-b4c1-33f479a8c765 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:33.729570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb94f47e-9ec5-44eb-b4c1-33f479a8c765 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:33.730009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb94f47e-9ec5-44eb-b4c1-33f479a8c765 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:33.890056 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fb94f47e-9ec5-44eb-b4c1-33f479a8c765 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:33.898285 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fb94f47e-9ec5-44eb-b4c1-33f479a8c765 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:33.899839 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fb94f47e-9ec5-44eb-b4c1-33f479a8c765 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:33.900972 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fb94f47e-9ec5-44eb-b4c1-33f479a8c765 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1725 microversion: 2.20 time: 0.185959 Jul 18 17:03:33.901580 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 660/1315] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:03:33 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:03:34.261112 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-d292159f-de19-4a20-80bd-3d134dbfefb4 req-7007fa4c-7df3-40d1-a7e4-6d0ebe0b924d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55db823-1c00-4ca0-bc6f-cd070459c5e9", "name": "network-vif-deleted", "tag": "2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:03:34.270750 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-d292159f-de19-4a20-80bd-3d134dbfefb4 req-7007fa4c-7df3-40d1-a7e4-6d0ebe0b924d service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:34.271400 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-d292159f-de19-4a20-80bd-3d134dbfefb4 req-7007fa4c-7df3-40d1-a7e4-6d0ebe0b924d service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:34.283757 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-d292159f-de19-4a20-80bd-3d134dbfefb4 req-7007fa4c-7df3-40d1-a7e4-6d0ebe0b924d service nova] Creating event network-vif-deleted:2a99c312-bc6e-4fbf-bfe9-c37cbbc1f662 for instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 on hv-cinder-83754 Jul 18 17:03:34.291287 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-d292159f-de19-4a20-80bd-3d134dbfefb4 req-7007fa4c-7df3-40d1-a7e4-6d0ebe0b924d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034049 Jul 18 17:03:34.292326 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 656/1316] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:34.920486 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ff0401ff-4124-48f2-8a27-17fd37315394 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:34.921133 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ff0401ff-4124-48f2-8a27-17fd37315394 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:34.928499 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff0401ff-4124-48f2-8a27-17fd37315394 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:34.928960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff0401ff-4124-48f2-8a27-17fd37315394 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:34.929811 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff0401ff-4124-48f2-8a27-17fd37315394 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:34.930263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff0401ff-4124-48f2-8a27-17fd37315394 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:34.965771 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff0401ff-4124-48f2-8a27-17fd37315394 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:34.966171 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff0401ff-4124-48f2-8a27-17fd37315394 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:34.966692 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-ff0401ff-4124-48f2-8a27-17fd37315394 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lazy-loading 'fault' on Instance uuid f55db823-1c00-4ca0-bc6f-cd070459c5e9 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:03:35.013679 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ff0401ff-4124-48f2-8a27-17fd37315394 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:35.024056 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ff0401ff-4124-48f2-8a27-17fd37315394 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:35.028122 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ff0401ff-4124-48f2-8a27-17fd37315394 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9faf38f2ccec4b60a3612648073d06d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a7e8f1e294903ade7a227878079f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:35.028122 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ff0401ff-4124-48f2-8a27-17fd37315394 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 200 len: 1371 microversion: 2.20 time: 0.110463 Jul 18 17:03:35.028122 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 661/1317] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:03:34 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:03:36.046463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5d05b537-698e-4359-ada5-58263ad48771 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:36.047161 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5d05b537-698e-4359-ada5-58263ad48771 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:36.054389 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d05b537-698e-4359-ada5-58263ad48771 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:36.054847 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d05b537-698e-4359-ada5-58263ad48771 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:36.056322 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d05b537-698e-4359-ada5-58263ad48771 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:36.058882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d05b537-698e-4359-ada5-58263ad48771 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:36.072377 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-5d05b537-698e-4359-ada5-58263ad48771 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] HTTP exception thrown: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5d05b537-698e-4359-ada5-58263ad48771 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Request method failure captured: Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 HTTP/1.1 Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-NJ-wbbiM9xCJbwFdrWzQjcz8YP3PFl0CMVulbm24L9VEOFZP79jbUbWmemkNpAqTGGSGXAPJNE_o9qqZOhqh_ZtOK0N-1p5u8yeTSMz1hZVlCbkQ9zwwyX-fyKBparcazCUtobVwtJrsFnNWXvhWr6GmIJTXsrdVv3lGQGA2exv8 Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: d75a7e8f1e294903ade7a227878079f8 Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:03:36.074174 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:03:36.076043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:03:36.076043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:36.076043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: d75a7e8f1e294903ade7a227878079f8 Jul 18 17:03:36.076043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:36.076043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeShelveTestJSON-332693562-project Jul 18 17:03:36.076043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:03:36.076043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:03:36.076043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 9faf38f2ccec4b60a3612648073d06d3 Jul 18 17:03:36.076043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeShelveTestJSON-332693562-project Jul 18 17:03:36.076043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:03:36.076043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:36.076043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': 'f55db823-1c00-4ca0-bc6f-cd070459c5e9'} Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:03:36.080535 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:36.082918 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:36.084456 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5d05b537-698e-4359-ada5-58263ad48771 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Returning 404 to user: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:03:36.084456 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5d05b537-698e-4359-ada5-58263ad48771 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 404 len: 111 microversion: 2.20 time: 0.033403 Jul 18 17:03:36.084456 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 657/1318] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:03:36 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 17:03:36.084851 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2766a0e9-9d19-4466-9909-d855edccfb9c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '.version_select at 0x7f4af17274c0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:36.198747 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2766a0e9-9d19-4466-9909-d855edccfb9c tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-661138906" status: 204 len: 0 microversion: 2.20 time: 0.117831 Jul 18 17:03:36.199680 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 662/1319] 10.222.0.76 () {60 vars in 1258 bytes} [Mon Jul 18 17:03:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-661138906 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 17:03:38.356384 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f83e2571-9292-443f-8579-7e40d4c5dd35 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:38.356872 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f83e2571-9292-443f-8579-7e40d4c5dd35 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:38.363605 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f83e2571-9292-443f-8579-7e40d4c5dd35 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:38.364061 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f83e2571-9292-443f-8579-7e40d4c5dd35 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:38.364838 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f83e2571-9292-443f-8579-7e40d4c5dd35 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:38.365307 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f83e2571-9292-443f-8579-7e40d4c5dd35 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:38.378877 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-f83e2571-9292-443f-8579-7e40d4c5dd35 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] HTTP exception thrown: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f83e2571-9292-443f-8579-7e40d4c5dd35 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Request method failure captured: Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 HTTP/1.1 Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-NJ-wbbiM9xCJbwFdrWzQjcz8YP3PFl0CMVulbm24L9VEOFZP79jbUbWmemkNpAqTGGSGXAPJNE_o9qqZOhqh_ZtOK0N-1p5u8yeTSMz1hZVlCbkQ9zwwyX-fyKBparcazCUtobVwtJrsFnNWXvhWr6GmIJTXsrdVv3lGQGA2exv8 Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: d75a7e8f1e294903ade7a227878079f8 Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:03:38.380413 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:03:38.381884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:03:38.381884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:38.381884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: d75a7e8f1e294903ade7a227878079f8 Jul 18 17:03:38.381884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:38.381884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeShelveTestJSON-332693562-project Jul 18 17:03:38.381884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:03:38.381884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:03:38.381884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 9faf38f2ccec4b60a3612648073d06d3 Jul 18 17:03:38.381884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeShelveTestJSON-332693562-project Jul 18 17:03:38.381884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:03:38.381884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:38.381884 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': 'f55db823-1c00-4ca0-bc6f-cd070459c5e9'} Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:03:38.382780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:38.385458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:38.386697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f83e2571-9292-443f-8579-7e40d4c5dd35 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Returning 404 to user: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:03:38.386697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f83e2571-9292-443f-8579-7e40d4c5dd35 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 404 len: 111 microversion: 2.20 time: 0.029543 Jul 18 17:03:38.386697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 658/1320] 10.222.0.76 () {60 vars in 1279 bytes} [Mon Jul 18 17:03:38 2022] DELETE /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 17:03:38.390912 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-18fcadb8-a3e4-4f6b-8fc1-4cb457d2ad1e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:38.391521 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-18fcadb8-a3e4-4f6b-8fc1-4cb457d2ad1e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: f55db823-1c00-4ca0-bc6f-cd070459c5e9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:38.399893 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18fcadb8-a3e4-4f6b-8fc1-4cb457d2ad1e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:38.400057 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18fcadb8-a3e4-4f6b-8fc1-4cb457d2ad1e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:38.400763 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18fcadb8-a3e4-4f6b-8fc1-4cb457d2ad1e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:38.401243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-18fcadb8-a3e4-4f6b-8fc1-4cb457d2ad1e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:38.415236 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-18fcadb8-a3e4-4f6b-8fc1-4cb457d2ad1e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] HTTP exception thrown: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-18fcadb8-a3e4-4f6b-8fc1-4cb457d2ad1e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Request method failure captured: Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 HTTP/1.1 Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y-NJ-wbbiM9xCJbwFdrWzQjcz8YP3PFl0CMVulbm24L9VEOFZP79jbUbWmemkNpAqTGGSGXAPJNE_o9qqZOhqh_ZtOK0N-1p5u8yeTSMz1hZVlCbkQ9zwwyX-fyKBparcazCUtobVwtJrsFnNWXvhWr6GmIJTXsrdVv3lGQGA2exv8 Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: d75a7e8f1e294903ade7a227878079f8 Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 17:03:38.416916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 17:03:38.418400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:03:38.418400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:38.418400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: d75a7e8f1e294903ade7a227878079f8 Jul 18 17:03:38.418400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:38.418400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeShelveTestJSON-332693562-project Jul 18 17:03:38.418400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 17:03:38.418400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 17:03:38.418400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 9faf38f2ccec4b60a3612648073d06d3 Jul 18 17:03:38.418400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-332693562-project Jul 18 17:03:38.418400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 17:03:38.418400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:38.418400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': 'f55db823-1c00-4ca0-bc6f-cd070459c5e9'} Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:03:38.419165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. Jul 18 17:03:38.420403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:38.421568 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-18fcadb8-a3e4-4f6b-8fc1-4cb457d2ad1e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Returning 404 to user: Instance f55db823-1c00-4ca0-bc6f-cd070459c5e9 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:03:38.421568 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-18fcadb8-a3e4-4f6b-8fc1-4cb457d2ad1e tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9" status: 404 len: 111 microversion: 2.20 time: 0.031428 Jul 18 17:03:38.421568 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 663/1321] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:03:38 2022] GET /compute/v2.1/servers/f55db823-1c00-4ca0-bc6f-cd070459c5e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 17:03:39.682231 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7cfdc016-10d9-4c29-844c-7846d30aa760 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:39.682735 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7cfdc016-10d9-4c29-844c-7846d30aa760 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:39.689378 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7cfdc016-10d9-4c29-844c-7846d30aa760 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:39.689775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7cfdc016-10d9-4c29-844c-7846d30aa760 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:39.690546 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7cfdc016-10d9-4c29-844c-7846d30aa760 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:39.690989 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7cfdc016-10d9-4c29-844c-7846d30aa760 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-7cfdc016-10d9-4c29-844c-7846d30aa760 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] HTTP exception thrown: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7cfdc016-10d9-4c29-844c-7846d30aa760 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Request method failure captured: Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 HTTP/1.1 Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-NJ-wbbiM9xCJbwFdrWzQjcz8YP3PFl0CMVulbm24L9VEOFZP79jbUbWmemkNpAqTGGSGXAPJNE_o9qqZOhqh_ZtOK0N-1p5u8yeTSMz1hZVlCbkQ9zwwyX-fyKBparcazCUtobVwtJrsFnNWXvhWr6GmIJTXsrdVv3lGQGA2exv8 Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: d75a7e8f1e294903ade7a227878079f8 Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:03:39.708730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:03:39.710563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:03:39.710563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:39.710563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: d75a7e8f1e294903ade7a227878079f8 Jul 18 17:03:39.710563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:39.710563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeShelveTestJSON-332693562-project Jul 18 17:03:39.710563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:03:39.710563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:03:39.710563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 9faf38f2ccec4b60a3612648073d06d3 Jul 18 17:03:39.710563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeShelveTestJSON-332693562-project Jul 18 17:03:39.710563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:03:39.710563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 17:03:39.710563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': 'c3d31815-4f8c-4e76-adcb-8039b88488d0'} Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:03:39.712244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 17:03:39.713775 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:03:39.715292 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7cfdc016-10d9-4c29-844c-7846d30aa760 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Returning 404 to user: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:03:39.715292 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7cfdc016-10d9-4c29-844c-7846d30aa760 tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 404 len: 111 microversion: 2.20 time: 0.029607 Jul 18 17:03:39.715292 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 659/1322] 10.222.0.76 () {60 vars in 1279 bytes} [Mon Jul 18 17:03:39 2022] DELETE /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 17:03:39.724033 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5333bc0b-c188-456a-b463-c33afda24c8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:39.724680 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5333bc0b-c188-456a-b463-c33afda24c8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] [instance: c3d31815-4f8c-4e76-adcb-8039b88488d0] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:39.733118 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5333bc0b-c188-456a-b463-c33afda24c8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:39.733579 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5333bc0b-c188-456a-b463-c33afda24c8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:39.734355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5333bc0b-c188-456a-b463-c33afda24c8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:39.738981 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5333bc0b-c188-456a-b463-c33afda24c8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:39.749462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-5333bc0b-c188-456a-b463-c33afda24c8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] HTTP exception thrown: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5333bc0b-c188-456a-b463-c33afda24c8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Request method failure captured: Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 HTTP/1.1 Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y-NJ-wbbiM9xCJbwFdrWzQjcz8YP3PFl0CMVulbm24L9VEOFZP79jbUbWmemkNpAqTGGSGXAPJNE_o9qqZOhqh_ZtOK0N-1p5u8yeTSMz1hZVlCbkQ9zwwyX-fyKBparcazCUtobVwtJrsFnNWXvhWr6GmIJTXsrdVv3lGQGA2exv8 Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: d75a7e8f1e294903ade7a227878079f8 Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 17:03:39.751018 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 17:03:39.752663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d75a7e8f1e294903ade7a227878079f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:03:39.752663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:39.752663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: d75a7e8f1e294903ade7a227878079f8 Jul 18 17:03:39.752663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-332693562 Jul 18 17:03:39.752663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeShelveTestJSON-332693562-project Jul 18 17:03:39.752663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 17:03:39.752663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 17:03:39.752663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 9faf38f2ccec4b60a3612648073d06d3 Jul 18 17:03:39.752663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-332693562-project Jul 18 17:03:39.752663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 17:03:39.752663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 17:03:39.752663 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': 'c3d31815-4f8c-4e76-adcb-8039b88488d0'} Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:03:39.753559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. Jul 18 17:03:39.755125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:03:39.756637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5333bc0b-c188-456a-b463-c33afda24c8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] Returning 404 to user: Instance c3d31815-4f8c-4e76-adcb-8039b88488d0 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:03:39.756637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5333bc0b-c188-456a-b463-c33afda24c8f tempest-AttachVolumeShelveTestJSON-332693562 tempest-AttachVolumeShelveTestJSON-332693562-project] 10.222.0.76 "GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0" status: 404 len: 111 microversion: 2.20 time: 0.032604 Jul 18 17:03:39.756637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 664/1323] 10.222.0.76 () {60 vars in 1276 bytes} [Mon Jul 18 17:03:39 2022] GET /compute/v2.1/servers/c3d31815-4f8c-4e76-adcb-8039b88488d0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 17:03:44.615970 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8ebb5b55-a551-469f-a657-31b475eaaf13 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:44.616536 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8ebb5b55-a551-469f-a657-31b475eaaf13 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:44.623486 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8ebb5b55-a551-469f-a657-31b475eaaf13 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:44.623928 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8ebb5b55-a551-469f-a657-31b475eaaf13 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:44.624696 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8ebb5b55-a551-469f-a657-31b475eaaf13 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:44.625173 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8ebb5b55-a551-469f-a657-31b475eaaf13 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:44.650080 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8ebb5b55-a551-469f-a657-31b475eaaf13 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/ips" status: 200 len: 151 microversion: 2.1 time: 0.312166 Jul 18 17:03:44.650730 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 660/1324] 10.222.0.76 () {58 vars in 1247 bytes} [Mon Jul 18 17:03:44 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/ips => generated 151 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:47.465000 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fd5d9802-f0bc-4eaf-bc70-9a2595c0914d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f863a355-3c33-49ec-84fb-7bed239bbbe5"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:03:47.466107 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fd5d9802-f0bc-4eaf-bc70-9a2595c0914d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:47.472887 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd5d9802-f0bc-4eaf-bc70-9a2595c0914d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:47.473387 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd5d9802-f0bc-4eaf-bc70-9a2595c0914d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:47.474222 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd5d9802-f0bc-4eaf-bc70-9a2595c0914d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:47.474705 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd5d9802-f0bc-4eaf-bc70-9a2595c0914d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:48.356087 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fd5d9802-f0bc-4eaf-bc70-9a2595c0914d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "POST /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895998 Jul 18 17:03:48.356691 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 665/1325] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 17:03:47 2022] POST /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments => generated 194 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:52.087300 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-60ca3c41-9896-4d36-b063-ba6b85ff862d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:52.087916 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-60ca3c41-9896-4d36-b063-ba6b85ff862d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:52.102115 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60ca3c41-9896-4d36-b063-ba6b85ff862d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:52.102800 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60ca3c41-9896-4d36-b063-ba6b85ff862d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:52.103973 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60ca3c41-9896-4d36-b063-ba6b85ff862d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:52.105140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60ca3c41-9896-4d36-b063-ba6b85ff862d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:52.139270 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-60ca3c41-9896-4d36-b063-ba6b85ff862d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:03:52.247449 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-5e3f5ed5-4ff7-4ade-a5f9-381abbf779e9 req-c28c355f-e176-496c-9a95-f77c119fb280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58499c89-21dc-4a75-9cae-b2cc7f7e90b9", "tag": "38df9321-fcab-4ab6-a5e8-5f70fc544990"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:03:52.256682 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-5e3f5ed5-4ff7-4ade-a5f9-381abbf779e9 req-c28c355f-e176-496c-9a95-f77c119fb280 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:52.257410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-5e3f5ed5-4ff7-4ade-a5f9-381abbf779e9 req-c28c355f-e176-496c-9a95-f77c119fb280 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:52.281157 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-5e3f5ed5-4ff7-4ade-a5f9-381abbf779e9 req-c28c355f-e176-496c-9a95-f77c119fb280 service nova] Creating event network-changed:38df9321-fcab-4ab6-a5e8-5f70fc544990 for instance 58499c89-21dc-4a75-9cae-b2cc7f7e90b9 on hv-cinder-83754 Jul 18 17:03:52.287312 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-5e3f5ed5-4ff7-4ade-a5f9-381abbf779e9 req-c28c355f-e176-496c-9a95-f77c119fb280 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196725 Jul 18 17:03:52.287913 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 666/1326] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:52.467233 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-60ca3c41-9896-4d36-b063-ba6b85ff862d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "DELETE /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 204 len: 0 microversion: 2.1 time: 0.383181 Jul 18 17:03:52.469357 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 661/1327] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:03:52 2022] DELETE /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:03:52.477781 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e7d6e4a3-b9f5-49e9-ba80-1265dfaceb5d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:52.478828 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e7d6e4a3-b9f5-49e9-ba80-1265dfaceb5d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:52.486279 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e7d6e4a3-b9f5-49e9-ba80-1265dfaceb5d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:52.486998 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e7d6e4a3-b9f5-49e9-ba80-1265dfaceb5d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:52.487783 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e7d6e4a3-b9f5-49e9-ba80-1265dfaceb5d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:52.488387 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e7d6e4a3-b9f5-49e9-ba80-1265dfaceb5d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:52.887194 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e7d6e4a3-b9f5-49e9-ba80-1265dfaceb5d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:52.895781 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e7d6e4a3-b9f5-49e9-ba80-1265dfaceb5d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1578 microversion: 2.1 time: 0.422201 Jul 18 17:03:52.898426 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 667/1328] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:52 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1578 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:03:53.915476 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8d649301-363b-4c00-b5e8-e1bc09bce2d5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:53.916766 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8d649301-363b-4c00-b5e8-e1bc09bce2d5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:53.926933 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d649301-363b-4c00-b5e8-e1bc09bce2d5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:53.927385 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d649301-363b-4c00-b5e8-e1bc09bce2d5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:53.928155 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d649301-363b-4c00-b5e8-e1bc09bce2d5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:53.928607 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d649301-363b-4c00-b5e8-e1bc09bce2d5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:54.071698 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8d649301-363b-4c00-b5e8-e1bc09bce2d5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:54.080617 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8d649301-363b-4c00-b5e8-e1bc09bce2d5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1578 microversion: 2.1 time: 0.169819 Jul 18 17:03:54.081229 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 662/1329] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:53 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:55.098218 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ff71e065-28d0-4f4e-84d9-c4fd5e34f66c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:55.098852 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ff71e065-28d0-4f4e-84d9-c4fd5e34f66c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:55.106331 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff71e065-28d0-4f4e-84d9-c4fd5e34f66c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:55.106779 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff71e065-28d0-4f4e-84d9-c4fd5e34f66c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:55.107573 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff71e065-28d0-4f4e-84d9-c4fd5e34f66c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:55.108078 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ff71e065-28d0-4f4e-84d9-c4fd5e34f66c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:55.254331 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ff71e065-28d0-4f4e-84d9-c4fd5e34f66c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:55.262810 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ff71e065-28d0-4f4e-84d9-c4fd5e34f66c tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1578 microversion: 2.1 time: 0.168195 Jul 18 17:03:55.263403 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 668/1330] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:55 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:56.282194 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-25248408-0090-4ad8-ac22-12046a8d02a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:56.282194 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-25248408-0090-4ad8-ac22-12046a8d02a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:56.284019 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:56.289152 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-25248408-0090-4ad8-ac22-12046a8d02a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:56.289614 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-25248408-0090-4ad8-ac22-12046a8d02a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:56.290389 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-25248408-0090-4ad8-ac22-12046a8d02a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:56.290828 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-25248408-0090-4ad8-ac22-12046a8d02a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:56.295537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:56.434390 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-25248408-0090-4ad8-ac22-12046a8d02a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:56.442267 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-25248408-0090-4ad8-ac22-12046a8d02a4 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1578 microversion: 2.1 time: 0.166166 Jul 18 17:03:56.442845 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 663/1331] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:56 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:57.461574 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f7903575-ba46-4bcb-aeef-b6ab5e18be36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:57.462135 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f7903575-ba46-4bcb-aeef-b6ab5e18be36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:57.464614 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:57.469689 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7903575-ba46-4bcb-aeef-b6ab5e18be36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:57.472328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7903575-ba46-4bcb-aeef-b6ab5e18be36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:57.472328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7903575-ba46-4bcb-aeef-b6ab5e18be36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:57.472328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7903575-ba46-4bcb-aeef-b6ab5e18be36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:57.474236 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:57.620619 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f7903575-ba46-4bcb-aeef-b6ab5e18be36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:57.633243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f7903575-ba46-4bcb-aeef-b6ab5e18be36 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1578 microversion: 2.1 time: 0.177372 Jul 18 17:03:57.634482 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 669/1332] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:57 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:58.652010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f6b1d11e-b660-4c6b-9d9c-f20c5be50093 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:58.652625 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f6b1d11e-b660-4c6b-9d9c-f20c5be50093 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:58.659347 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f6b1d11e-b660-4c6b-9d9c-f20c5be50093 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:58.659801 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f6b1d11e-b660-4c6b-9d9c-f20c5be50093 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:58.660698 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f6b1d11e-b660-4c6b-9d9c-f20c5be50093 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:58.661055 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f6b1d11e-b660-4c6b-9d9c-f20c5be50093 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:58.806286 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f6b1d11e-b660-4c6b-9d9c-f20c5be50093 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:58.814545 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f6b1d11e-b660-4c6b-9d9c-f20c5be50093 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1459 microversion: 2.1 time: 0.167025 Jul 18 17:03:58.815123 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 664/1333] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:58 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1459 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:59.480410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-b9c480ce-aeb7-469a-8d55-ef5bbaef4cfb req-d8fc1bc7-e869-4934-be42-26a228d40dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58499c89-21dc-4a75-9cae-b2cc7f7e90b9", "name": "network-vif-deleted", "tag": "38df9321-fcab-4ab6-a5e8-5f70fc544990"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:03:59.491718 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-b9c480ce-aeb7-469a-8d55-ef5bbaef4cfb req-d8fc1bc7-e869-4934-be42-26a228d40dcf service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:59.495393 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-b9c480ce-aeb7-469a-8d55-ef5bbaef4cfb req-d8fc1bc7-e869-4934-be42-26a228d40dcf service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:59.505551 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-b9c480ce-aeb7-469a-8d55-ef5bbaef4cfb req-d8fc1bc7-e869-4934-be42-26a228d40dcf service nova] Creating event network-vif-deleted:38df9321-fcab-4ab6-a5e8-5f70fc544990 for instance 58499c89-21dc-4a75-9cae-b2cc7f7e90b9 on hv-cinder-83754 Jul 18 17:03:59.511185 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-b9c480ce-aeb7-469a-8d55-ef5bbaef4cfb req-d8fc1bc7-e869-4934-be42-26a228d40dcf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035559 Jul 18 17:03:59.517499 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 670/1334] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:59.832026 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6acfc187-6769-466b-b17a-4128b5acd85d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:59.832643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6acfc187-6769-466b-b17a-4128b5acd85d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:59.839571 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6acfc187-6769-466b-b17a-4128b5acd85d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:59.840019 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6acfc187-6769-466b-b17a-4128b5acd85d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:59.841002 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6acfc187-6769-466b-b17a-4128b5acd85d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:59.841483 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6acfc187-6769-466b-b17a-4128b5acd85d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:59.911999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6acfc187-6769-466b-b17a-4128b5acd85d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:59.928034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6acfc187-6769-466b-b17a-4128b5acd85d tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1226 microversion: 2.1 time: 0.099820 Jul 18 17:03:59.929353 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 665/1335] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:59 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:04:00.527396 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7853ead8-230c-469e-9a7e-e84356bcdb7f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:00.527995 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7853ead8-230c-469e-9a7e-e84356bcdb7f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:00.536535 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7853ead8-230c-469e-9a7e-e84356bcdb7f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:00.537002 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7853ead8-230c-469e-9a7e-e84356bcdb7f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:00.537868 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7853ead8-230c-469e-9a7e-e84356bcdb7f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:00.538314 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7853ead8-230c-469e-9a7e-e84356bcdb7f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:00.657029 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-7853ead8-230c-469e-9a7e-e84356bcdb7f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lazy-loading 'services' on Instance uuid 79f024cc-89d3-458a-9095-be12de8d51ee {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:04:00.926798 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7853ead8-230c-469e-9a7e-e84356bcdb7f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments/f863a355-3c33-49ec-84fb-7bed239bbbe5" status: 202 len: 0 microversion: 2.1 time: 0.407807 Jul 18 17:04:00.929902 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 671/1336] 10.222.0.76 () {58 vars in 1415 bytes} [Mon Jul 18 17:04:00 2022] DELETE /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments/f863a355-3c33-49ec-84fb-7bed239bbbe5 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:04:00.938579 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-864a1ee0-2511-48e0-8f2c-b5d36ed49162 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:00.941784 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-864a1ee0-2511-48e0-8f2c-b5d36ed49162 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:00.949094 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-864a1ee0-2511-48e0-8f2c-b5d36ed49162 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:00.949803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-864a1ee0-2511-48e0-8f2c-b5d36ed49162 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:00.950839 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-864a1ee0-2511-48e0-8f2c-b5d36ed49162 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:00.951312 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-056d9cce-5386-4387-bd7c-4b6d7855c350 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:00.951668 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-864a1ee0-2511-48e0-8f2c-b5d36ed49162 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:00.952023 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-056d9cce-5386-4387-bd7c-4b6d7855c350 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:00.958706 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-056d9cce-5386-4387-bd7c-4b6d7855c350 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:00.959415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-056d9cce-5386-4387-bd7c-4b6d7855c350 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:00.960364 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-056d9cce-5386-4387-bd7c-4b6d7855c350 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:00.960964 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-056d9cce-5386-4387-bd7c-4b6d7855c350 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:00.984854 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-864a1ee0-2511-48e0-8f2c-b5d36ed49162 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049953 Jul 18 17:04:00.985466 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 666/1337] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:04:00 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:04:00.996378 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-056d9cce-5386-4387-bd7c-4b6d7855c350 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:00.996830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-056d9cce-5386-4387-bd7c-4b6d7855c350 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:00.997389 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-056d9cce-5386-4387-bd7c-4b6d7855c350 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lazy-loading 'fault' on Instance uuid 58499c89-21dc-4a75-9cae-b2cc7f7e90b9 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:04:01.045769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-056d9cce-5386-4387-bd7c-4b6d7855c350 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:01.053405 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-056d9cce-5386-4387-bd7c-4b6d7855c350 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 200 len: 1231 microversion: 2.1 time: 0.110904 Jul 18 17:04:01.053981 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 672/1338] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:00 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 1231 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:01.997964 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-aeb25e4a-e7e5-42c5-9287-1edcf9b51e60 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:01.998809 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-aeb25e4a-e7e5-42c5-9287-1edcf9b51e60 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:02.005299 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aeb25e4a-e7e5-42c5-9287-1edcf9b51e60 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:02.005757 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aeb25e4a-e7e5-42c5-9287-1edcf9b51e60 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:02.006524 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aeb25e4a-e7e5-42c5-9287-1edcf9b51e60 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:02.006968 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aeb25e4a-e7e5-42c5-9287-1edcf9b51e60 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:02.036790 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-aeb25e4a-e7e5-42c5-9287-1edcf9b51e60 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043390 Jul 18 17:04:02.037373 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 667/1339] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:04:01 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:04:02.071687 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e266be8f-7157-490b-a590-2d4a85fd276b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:02.072986 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e266be8f-7157-490b-a590-2d4a85fd276b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 58499c89-21dc-4a75-9cae-b2cc7f7e90b9] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:02.079625 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e266be8f-7157-490b-a590-2d4a85fd276b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:02.080083 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e266be8f-7157-490b-a590-2d4a85fd276b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:02.080859 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e266be8f-7157-490b-a590-2d4a85fd276b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:02.081395 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e266be8f-7157-490b-a590-2d4a85fd276b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:02.095846 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-e266be8f-7157-490b-a590-2d4a85fd276b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] HTTP exception thrown: Instance 58499c89-21dc-4a75-9cae-b2cc7f7e90b9 could not be found. Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e266be8f-7157-490b-a590-2d4a85fd276b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Request method failure captured: Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 HTTP/1.1 Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1ZAW45tf-ENfewcMUQEQN3d3TEIMWs_3d-y6pvASiuvpL6MwUL4uSy8Y0Acg2NzQG_BedrYuOQ2FRzude0kvF9E2LfOwcj-cTTFxdaL1F5nYNOs0AQWJwxm_Q_-4wc7oozlIpzXtOBSVrxIX_T_p4VHuKuaozxX02JrEaqWI093VWf8 Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 997c256859f2484e8465c043b3d2299d Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-TestVolumeBootPattern-626268263 Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 17:04:02.097554 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 17:04:02.099303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_997c256859f2484e8465c043b3d2299d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/997c256859f2484e8465c043b3d2299d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/997c256859f2484e8465c043b3d2299d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/997c256859f2484e8465c043b3d2299d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:02.099303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-TestVolumeBootPattern-626268263 Jul 18 17:04:02.099303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 997c256859f2484e8465c043b3d2299d Jul 18 17:04:02.099303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-TestVolumeBootPattern-626268263 Jul 18 17:04:02.099303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-TestVolumeBootPattern-626268263-project Jul 18 17:04:02.099303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 17:04:02.099303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 17:04:02.099303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 4ad27549c1824d45b1d55653e2c121a8 Jul 18 17:04:02.099303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-TestVolumeBootPattern-626268263-project Jul 18 17:04:02.099303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 17:04:02.099303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance 58499c89-21dc-4a75-9cae-b2cc7f7e90b9 could not be found. Jul 18 17:04:02.099303 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '58499c89-21dc-4a75-9cae-b2cc7f7e90b9'} Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58499c89-21dc-4a75-9cae-b2cc7f7e90b9 could not be found. Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:02.100265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58499c89-21dc-4a75-9cae-b2cc7f7e90b9 could not be found. Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58499c89-21dc-4a75-9cae-b2cc7f7e90b9 could not be found. Jul 18 17:04:02.101916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:02.103382 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e266be8f-7157-490b-a590-2d4a85fd276b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Returning 404 to user: Instance 58499c89-21dc-4a75-9cae-b2cc7f7e90b9 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:02.103382 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e266be8f-7157-490b-a590-2d4a85fd276b tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9" status: 404 len: 111 microversion: 2.1 time: 0.031095 Jul 18 17:04:02.103382 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 673/1340] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:02 2022] GET /compute/v2.1/servers/58499c89-21dc-4a75-9cae-b2cc7f7e90b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:04:03.048811 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0da8c63e-99b0-4eed-ab0b-9ed6ed5a9cf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:03.050325 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0da8c63e-99b0-4eed-ab0b-9ed6ed5a9cf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:03.062105 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0da8c63e-99b0-4eed-ab0b-9ed6ed5a9cf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:03.062707 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0da8c63e-99b0-4eed-ab0b-9ed6ed5a9cf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:03.064046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0da8c63e-99b0-4eed-ab0b-9ed6ed5a9cf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:03.065220 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0da8c63e-99b0-4eed-ab0b-9ed6ed5a9cf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:03.099864 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0da8c63e-99b0-4eed-ab0b-9ed6ed5a9cf7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055105 Jul 18 17:04:03.100355 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 668/1341] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:04:03 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:04:04.113436 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ceb585c4-89c7-4bfe-9d0d-63c0ffa75a99 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:04.113921 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ceb585c4-89c7-4bfe-9d0d-63c0ffa75a99 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:04.121072 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ceb585c4-89c7-4bfe-9d0d-63c0ffa75a99 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:04.121537 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ceb585c4-89c7-4bfe-9d0d-63c0ffa75a99 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:04.122328 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ceb585c4-89c7-4bfe-9d0d-63c0ffa75a99 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:04.122770 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ceb585c4-89c7-4bfe-9d0d-63c0ffa75a99 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:04.154837 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ceb585c4-89c7-4bfe-9d0d-63c0ffa75a99 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046459 Jul 18 17:04:04.155509 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 674/1342] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:04:04 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:04:05.167178 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bc814f8f-8aba-42e0-a91f-a359727e2247 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:05.168699 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bc814f8f-8aba-42e0-a91f-a359727e2247 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:05.175516 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bc814f8f-8aba-42e0-a91f-a359727e2247 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:05.175965 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bc814f8f-8aba-42e0-a91f-a359727e2247 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:05.176734 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bc814f8f-8aba-42e0-a91f-a359727e2247 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:05.177202 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bc814f8f-8aba-42e0-a91f-a359727e2247 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:05.213101 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bc814f8f-8aba-42e0-a91f-a359727e2247 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049988 Jul 18 17:04:05.216622 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 669/1343] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:04:05 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:04:06.224724 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6e134b61-eda5-492f-b699-a77f7e7912e4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:06.225631 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6e134b61-eda5-492f-b699-a77f7e7912e4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:06.233668 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e134b61-eda5-492f-b699-a77f7e7912e4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:06.234383 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e134b61-eda5-492f-b699-a77f7e7912e4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:06.235161 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e134b61-eda5-492f-b699-a77f7e7912e4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:06.235604 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e134b61-eda5-492f-b699-a77f7e7912e4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:06.267151 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6e134b61-eda5-492f-b699-a77f7e7912e4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Jul 18 17:04:06.267853 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 675/1344] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:04:06 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:04:07.279778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0eb5ed10-c443-41dc-93a9-4fe91e9f2c32 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:07.280693 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0eb5ed10-c443-41dc-93a9-4fe91e9f2c32 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:07.287325 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0eb5ed10-c443-41dc-93a9-4fe91e9f2c32 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:07.287812 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0eb5ed10-c443-41dc-93a9-4fe91e9f2c32 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:07.288564 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0eb5ed10-c443-41dc-93a9-4fe91e9f2c32 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:07.289874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0eb5ed10-c443-41dc-93a9-4fe91e9f2c32 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:07.319432 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0eb5ed10-c443-41dc-93a9-4fe91e9f2c32 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044391 Jul 18 17:04:07.319988 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 670/1345] 10.222.0.76 () {58 vars in 1301 bytes} [Mon Jul 18 17:04:07 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 17:04:07.379652 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cf03e865-a5a7-490b-9116-6b935dbbddb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:07.380151 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cf03e865-a5a7-490b-9116-6b935dbbddb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:07.391092 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cf03e865-a5a7-490b-9116-6b935dbbddb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:07.391092 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cf03e865-a5a7-490b-9116-6b935dbbddb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:07.391092 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cf03e865-a5a7-490b-9116-6b935dbbddb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:07.391092 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cf03e865-a5a7-490b-9116-6b935dbbddb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:07.419729 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cf03e865-a5a7-490b-9116-6b935dbbddb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:04:07.710022 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cf03e865-a5a7-490b-9116-6b935dbbddb4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 204 len: 0 microversion: 2.1 time: 0.334440 Jul 18 17:04:07.710622 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 676/1346] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:04:07 2022] DELETE /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:04:07.719605 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-396bafc0-215f-4530-a7fe-5ce1b9cee416 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:07.724296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-396bafc0-215f-4530-a7fe-5ce1b9cee416 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:07.726314 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-396bafc0-215f-4530-a7fe-5ce1b9cee416 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:07.726761 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-396bafc0-215f-4530-a7fe-5ce1b9cee416 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:07.727518 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-396bafc0-215f-4530-a7fe-5ce1b9cee416 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:07.727948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-396bafc0-215f-4530-a7fe-5ce1b9cee416 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:07.867630 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-396bafc0-215f-4530-a7fe-5ce1b9cee416 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:07.876307 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-396bafc0-215f-4530-a7fe-5ce1b9cee416 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1683 microversion: 2.1 time: 0.160535 Jul 18 17:04:07.876883 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 671/1347] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:07 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:08.895685 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fa047b72-0b9e-4c9b-8623-cd2643b14ab6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:08.896445 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fa047b72-0b9e-4c9b-8623-cd2643b14ab6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:08.904090 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa047b72-0b9e-4c9b-8623-cd2643b14ab6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:08.907755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa047b72-0b9e-4c9b-8623-cd2643b14ab6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:08.907755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa047b72-0b9e-4c9b-8623-cd2643b14ab6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:08.907755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa047b72-0b9e-4c9b-8623-cd2643b14ab6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:09.043263 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fa047b72-0b9e-4c9b-8623-cd2643b14ab6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:09.047860 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fa047b72-0b9e-4c9b-8623-cd2643b14ab6 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1683 microversion: 2.1 time: 0.156509 Jul 18 17:04:09.048599 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 677/1348] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:08 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:09.833609 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-27c7f5ea-a530-4893-bda1-7743af96e76a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:09.834269 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-27c7f5ea-a530-4893-bda1-7743af96e76a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:09.836235 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-c7882fc6-7b15-4b0f-ba36-11c459145d51 req-aa16fb78-dd61-4717-ac30-4cd14d49129d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59d02fb-6042-4f0e-a98a-38c41602027a", "tag": "b1ef0b33-c13f-4547-a433-408579d14c01"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:04:09.841423 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27c7f5ea-a530-4893-bda1-7743af96e76a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:09.841824 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27c7f5ea-a530-4893-bda1-7743af96e76a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:09.842822 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27c7f5ea-a530-4893-bda1-7743af96e76a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:09.843393 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27c7f5ea-a530-4893-bda1-7743af96e76a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:09.846314 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c7882fc6-7b15-4b0f-ba36-11c459145d51 req-aa16fb78-dd61-4717-ac30-4cd14d49129d service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:09.846314 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c7882fc6-7b15-4b0f-ba36-11c459145d51 req-aa16fb78-dd61-4717-ac30-4cd14d49129d service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:09.858157 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-c7882fc6-7b15-4b0f-ba36-11c459145d51 req-aa16fb78-dd61-4717-ac30-4cd14d49129d service nova] Creating event network-changed:b1ef0b33-c13f-4547-a433-408579d14c01 for instance e59d02fb-6042-4f0e-a98a-38c41602027a on hv-cinder-83754 Jul 18 17:04:09.865040 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-c7882fc6-7b15-4b0f-ba36-11c459145d51 req-aa16fb78-dd61-4717-ac30-4cd14d49129d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031169 Jul 18 17:04:09.865040 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 678/1349] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:04:09.874152 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-27c7f5ea-a530-4893-bda1-7743af96e76a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:04:10.067096 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8be5ea29-6d72-4542-925a-6f8837cd3582 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:10.067808 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8be5ea29-6d72-4542-925a-6f8837cd3582 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:10.075049 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8be5ea29-6d72-4542-925a-6f8837cd3582 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:10.075517 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8be5ea29-6d72-4542-925a-6f8837cd3582 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:10.076316 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8be5ea29-6d72-4542-925a-6f8837cd3582 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:10.077053 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8be5ea29-6d72-4542-925a-6f8837cd3582 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:10.160189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-27c7f5ea-a530-4893-bda1-7743af96e76a tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 204 len: 0 microversion: 2.1 time: 0.325373 Jul 18 17:04:10.160189 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 672/1350] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:04:09 2022] DELETE /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:04:10.164882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7f70a5d4-e2a0-4e7e-882d-31e3a7b5bd16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:10.165672 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7f70a5d4-e2a0-4e7e-882d-31e3a7b5bd16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:10.182398 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7f70a5d4-e2a0-4e7e-882d-31e3a7b5bd16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:10.182999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7f70a5d4-e2a0-4e7e-882d-31e3a7b5bd16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:10.183789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7f70a5d4-e2a0-4e7e-882d-31e3a7b5bd16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:10.184276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7f70a5d4-e2a0-4e7e-882d-31e3a7b5bd16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:10.231143 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8be5ea29-6d72-4542-925a-6f8837cd3582 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:10.248061 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8be5ea29-6d72-4542-925a-6f8837cd3582 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1683 microversion: 2.1 time: 0.185758 Jul 18 17:04:10.249418 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 679/1351] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:10 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:04:10.267687 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:04:10.267839 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Mon Jul 18 17:04:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a (ip 10.222.0.76) !!! Jul 18 17:04:10.352010 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7f70a5d4-e2a0-4e7e-882d-31e3a7b5bd16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:10.362910 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7f70a5d4-e2a0-4e7e-882d-31e3a7b5bd16 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1575 microversion: 2.1 time: 0.202736 Jul 18 17:04:10.363595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 673/1352] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:10 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:04:11.265785 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-09a31965-54a7-4322-8ed6-ecf2fd03c1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:11.266400 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-09a31965-54a7-4322-8ed6-ecf2fd03c1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:11.272927 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-09a31965-54a7-4322-8ed6-ecf2fd03c1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:11.273410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-09a31965-54a7-4322-8ed6-ecf2fd03c1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:11.274170 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-09a31965-54a7-4322-8ed6-ecf2fd03c1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:11.274606 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-09a31965-54a7-4322-8ed6-ecf2fd03c1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:11.383303 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b6d267df-a8fc-4274-8d30-7a3c79e8df22 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:11.384018 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b6d267df-a8fc-4274-8d30-7a3c79e8df22 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:11.390675 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b6d267df-a8fc-4274-8d30-7a3c79e8df22 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:11.391131 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b6d267df-a8fc-4274-8d30-7a3c79e8df22 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:11.391899 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b6d267df-a8fc-4274-8d30-7a3c79e8df22 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:11.392340 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b6d267df-a8fc-4274-8d30-7a3c79e8df22 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:11.409143 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-09a31965-54a7-4322-8ed6-ecf2fd03c1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:11.417345 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-09a31965-54a7-4322-8ed6-ecf2fd03c1bc tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1683 microversion: 2.1 time: 0.154633 Jul 18 17:04:11.417345 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 680/1353] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:11 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:11.529927 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b6d267df-a8fc-4274-8d30-7a3c79e8df22 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:11.537539 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b6d267df-a8fc-4274-8d30-7a3c79e8df22 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1575 microversion: 2.1 time: 0.158124 Jul 18 17:04:11.538102 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 674/1354] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:11 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:04:12.434657 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7a26ac61-9179-496d-99c3-a7f48f08db96 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:12.435227 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7a26ac61-9179-496d-99c3-a7f48f08db96 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:12.441800 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a26ac61-9179-496d-99c3-a7f48f08db96 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:12.442261 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a26ac61-9179-496d-99c3-a7f48f08db96 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:12.443023 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a26ac61-9179-496d-99c3-a7f48f08db96 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:12.443464 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a26ac61-9179-496d-99c3-a7f48f08db96 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:12.555315 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-36628288-260d-48ce-9086-0d9ef6d1a7f1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:12.556021 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-36628288-260d-48ce-9086-0d9ef6d1a7f1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:12.562857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36628288-260d-48ce-9086-0d9ef6d1a7f1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:12.563383 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36628288-260d-48ce-9086-0d9ef6d1a7f1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:12.564285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36628288-260d-48ce-9086-0d9ef6d1a7f1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:12.564789 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36628288-260d-48ce-9086-0d9ef6d1a7f1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:12.585541 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7a26ac61-9179-496d-99c3-a7f48f08db96 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:12.593932 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7a26ac61-9179-496d-99c3-a7f48f08db96 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1683 microversion: 2.1 time: 0.163380 Jul 18 17:04:12.594454 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 681/1355] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:12 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:12.700862 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-36628288-260d-48ce-9086-0d9ef6d1a7f1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:12.708525 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-36628288-260d-48ce-9086-0d9ef6d1a7f1 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1575 microversion: 2.1 time: 0.157370 Jul 18 17:04:12.709082 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 675/1356] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:12 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:04:13.611531 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-454299a1-d340-4328-90a1-2afb0324059d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:13.612124 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-454299a1-d340-4328-90a1-2afb0324059d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:13.618983 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-454299a1-d340-4328-90a1-2afb0324059d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:13.619436 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-454299a1-d340-4328-90a1-2afb0324059d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:13.620556 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-454299a1-d340-4328-90a1-2afb0324059d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:13.621004 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-454299a1-d340-4328-90a1-2afb0324059d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:13.725879 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b7d7db4a-db38-4e5c-a607-77a983c567f5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:13.726490 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b7d7db4a-db38-4e5c-a607-77a983c567f5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:13.734218 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b7d7db4a-db38-4e5c-a607-77a983c567f5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:13.734676 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b7d7db4a-db38-4e5c-a607-77a983c567f5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:13.735445 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b7d7db4a-db38-4e5c-a607-77a983c567f5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:13.735896 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b7d7db4a-db38-4e5c-a607-77a983c567f5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:13.763758 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-454299a1-d340-4328-90a1-2afb0324059d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:13.772287 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-454299a1-d340-4328-90a1-2afb0324059d tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1683 microversion: 2.1 time: 0.164849 Jul 18 17:04:13.773417 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 682/1357] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:13 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:13.878366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b7d7db4a-db38-4e5c-a607-77a983c567f5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:13.886088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b7d7db4a-db38-4e5c-a607-77a983c567f5 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1575 microversion: 2.1 time: 0.164229 Jul 18 17:04:13.886658 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 676/1358] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:13 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:04:14.792221 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7c3c100d-6d47-427d-a703-05a7c95eb0b3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:14.793042 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7c3c100d-6d47-427d-a703-05a7c95eb0b3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:14.800154 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c3c100d-6d47-427d-a703-05a7c95eb0b3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:14.801995 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c3c100d-6d47-427d-a703-05a7c95eb0b3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:14.801995 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c3c100d-6d47-427d-a703-05a7c95eb0b3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:14.802165 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c3c100d-6d47-427d-a703-05a7c95eb0b3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:14.911290 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ed28e649-4328-4e43-b160-b1bd992d4de6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:14.911290 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ed28e649-4328-4e43-b160-b1bd992d4de6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:14.913992 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed28e649-4328-4e43-b160-b1bd992d4de6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:14.914569 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed28e649-4328-4e43-b160-b1bd992d4de6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:14.915454 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed28e649-4328-4e43-b160-b1bd992d4de6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:14.916012 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed28e649-4328-4e43-b160-b1bd992d4de6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:14.963889 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7c3c100d-6d47-427d-a703-05a7c95eb0b3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:14.971622 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7c3c100d-6d47-427d-a703-05a7c95eb0b3 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1683 microversion: 2.1 time: 0.183579 Jul 18 17:04:14.974126 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 683/1359] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:14 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:04:15.279752 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ed28e649-4328-4e43-b160-b1bd992d4de6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:15.287269 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ed28e649-4328-4e43-b160-b1bd992d4de6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1575 microversion: 2.1 time: 0.388157 Jul 18 17:04:15.297002 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 677/1360] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:14 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1575 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:04:15.801825 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-de600409-c96f-4719-a677-f21b2b625afa req-c7ff21ff-21bb-465e-a6f5-1b566c1a7b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f024cc-89d3-458a-9095-be12de8d51ee", "name": "network-vif-deleted", "tag": "be58750b-20bf-4709-a370-f4aa2631f5f9"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:04:15.819014 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-de600409-c96f-4719-a677-f21b2b625afa req-c7ff21ff-21bb-465e-a6f5-1b566c1a7b6b service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:15.820115 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-de600409-c96f-4719-a677-f21b2b625afa req-c7ff21ff-21bb-465e-a6f5-1b566c1a7b6b service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:15.849489 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-de600409-c96f-4719-a677-f21b2b625afa req-c7ff21ff-21bb-465e-a6f5-1b566c1a7b6b service nova] Creating event network-vif-deleted:be58750b-20bf-4709-a370-f4aa2631f5f9 for instance 79f024cc-89d3-458a-9095-be12de8d51ee on hv-cinder-83754 Jul 18 17:04:15.857109 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-de600409-c96f-4719-a677-f21b2b625afa req-c7ff21ff-21bb-465e-a6f5-1b566c1a7b6b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062179 Jul 18 17:04:15.858773 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 684/1361] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:04:15.989826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f767fbf0-80e1-43f4-88ac-a602f1841300 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:15.990768 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f767fbf0-80e1-43f4-88ac-a602f1841300 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:15.997924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f767fbf0-80e1-43f4-88ac-a602f1841300 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:16.004243 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f767fbf0-80e1-43f4-88ac-a602f1841300 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:16.004243 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f767fbf0-80e1-43f4-88ac-a602f1841300 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:16.004243 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f767fbf0-80e1-43f4-88ac-a602f1841300 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:16.008759 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:16.118044 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f767fbf0-80e1-43f4-88ac-a602f1841300 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf277a2d03443c8af7a7bee2731d9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82344d2255427582cc29e253b37f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:16.127586 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f767fbf0-80e1-43f4-88ac-a602f1841300 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 200 len: 1327 microversion: 2.1 time: 0.140920 Jul 18 17:04:16.127586 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 678/1362] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:15 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 1327 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:16.305095 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f8e23373-c14d-4fcd-a6fe-c3423b5b4c13 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:16.305778 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f8e23373-c14d-4fcd-a6fe-c3423b5b4c13 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:16.322969 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8e23373-c14d-4fcd-a6fe-c3423b5b4c13 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:16.322969 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8e23373-c14d-4fcd-a6fe-c3423b5b4c13 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:16.322969 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8e23373-c14d-4fcd-a6fe-c3423b5b4c13 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:16.323828 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8e23373-c14d-4fcd-a6fe-c3423b5b4c13 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:16.545872 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f8e23373-c14d-4fcd-a6fe-c3423b5b4c13 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:16.548762 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:16.562583 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f8e23373-c14d-4fcd-a6fe-c3423b5b4c13 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1457 microversion: 2.1 time: 0.261461 Jul 18 17:04:16.564193 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 685/1363] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:16 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1457 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:17.147220 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-649e85cb-2248-4d31-b397-46bd23ca475f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:17.148492 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-649e85cb-2248-4d31-b397-46bd23ca475f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:17.157924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-649e85cb-2248-4d31-b397-46bd23ca475f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:17.158301 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-649e85cb-2248-4d31-b397-46bd23ca475f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:17.159078 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-649e85cb-2248-4d31-b397-46bd23ca475f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:17.159524 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-649e85cb-2248-4d31-b397-46bd23ca475f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:17.174927 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-649e85cb-2248-4d31-b397-46bd23ca475f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-649e85cb-2248-4d31-b397-46bd23ca475f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee HTTP/1.1 Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:04:17.176366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:04:17.177924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:17.177924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:17.177924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:17.177924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:17.177924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:17.177924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:04:17.177924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:04:17.177924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 17:04:17.177924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:17.177924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:04:17.177924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:17.177924 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '79f024cc-89d3-458a-9095-be12de8d51ee'} Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:17.178729 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:17.180374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:17.182207 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-649e85cb-2248-4d31-b397-46bd23ca475f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 404 to user: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:17.182207 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-649e85cb-2248-4d31-b397-46bd23ca475f tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 404 len: 111 microversion: 2.1 time: 0.035458 Jul 18 17:04:17.188030 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f1e6d4df-60de-4344-a7c0-df455f704287 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '.version_select at 0x7f4af18c41f0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:17.194739 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 679/1364] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:17 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:04:17.241874 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f1e6d4df-60de-4344-a7c0-df455f704287 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575436049" status: 202 len: 0 microversion: 2.1 time: 0.058549 Jul 18 17:04:17.242466 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 686/1365] 10.222.0.76 () {58 vars in 1220 bytes} [Mon Jul 18 17:04:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575436049 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:04:17.580673 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5f285c58-c73b-43dc-b8bf-111e84013683 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:17.581306 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5f285c58-c73b-43dc-b8bf-111e84013683 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:17.589148 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f285c58-c73b-43dc-b8bf-111e84013683 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:17.589613 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f285c58-c73b-43dc-b8bf-111e84013683 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:17.590402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f285c58-c73b-43dc-b8bf-111e84013683 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:17.590848 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f285c58-c73b-43dc-b8bf-111e84013683 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:17.843940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5f285c58-c73b-43dc-b8bf-111e84013683 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:17.853644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5f285c58-c73b-43dc-b8bf-111e84013683 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1225 microversion: 2.1 time: 0.276974 Jul 18 17:04:17.854227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 680/1366] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:17 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1225 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:17.881952 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-dc8d2673-bcad-445a-93dd-fc2073a1e36d req-99b7fc8c-3b30-4d43-949a-2935a6adda5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59d02fb-6042-4f0e-a98a-38c41602027a", "name": "network-vif-deleted", "tag": "b1ef0b33-c13f-4547-a433-408579d14c01"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:04:17.894115 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-dc8d2673-bcad-445a-93dd-fc2073a1e36d req-99b7fc8c-3b30-4d43-949a-2935a6adda5c service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:17.894115 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-dc8d2673-bcad-445a-93dd-fc2073a1e36d req-99b7fc8c-3b30-4d43-949a-2935a6adda5c service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:17.904142 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-dc8d2673-bcad-445a-93dd-fc2073a1e36d req-99b7fc8c-3b30-4d43-949a-2935a6adda5c service nova] Creating event network-vif-deleted:b1ef0b33-c13f-4547-a433-408579d14c01 for instance e59d02fb-6042-4f0e-a98a-38c41602027a on hv-cinder-83754 Jul 18 17:04:17.908884 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-dc8d2673-bcad-445a-93dd-fc2073a1e36d req-99b7fc8c-3b30-4d43-949a-2935a6adda5c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031424 Jul 18 17:04:17.909722 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 687/1367] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:04:18.871673 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-75c362fa-72aa-44a9-ba57-b6bdf26d3242 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:18.872204 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-75c362fa-72aa-44a9-ba57-b6bdf26d3242 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:18.878978 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-75c362fa-72aa-44a9-ba57-b6bdf26d3242 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:18.879377 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-75c362fa-72aa-44a9-ba57-b6bdf26d3242 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:18.880155 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-75c362fa-72aa-44a9-ba57-b6bdf26d3242 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:18.880616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-75c362fa-72aa-44a9-ba57-b6bdf26d3242 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:18.942620 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-75c362fa-72aa-44a9-ba57-b6bdf26d3242 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:18.951389 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-75c362fa-72aa-44a9-ba57-b6bdf26d3242 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1225 microversion: 2.1 time: 0.084321 Jul 18 17:04:18.951954 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 681/1368] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:18 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:19.969174 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-91d2e591-a080-4d1e-94fd-1d4c035dbe25 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:19.969982 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-91d2e591-a080-4d1e-94fd-1d4c035dbe25 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:19.976728 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-91d2e591-a080-4d1e-94fd-1d4c035dbe25 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:19.977214 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-91d2e591-a080-4d1e-94fd-1d4c035dbe25 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:19.978016 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-91d2e591-a080-4d1e-94fd-1d4c035dbe25 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:19.978453 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-91d2e591-a080-4d1e-94fd-1d4c035dbe25 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:20.051450 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-91d2e591-a080-4d1e-94fd-1d4c035dbe25 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:20.062080 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-91d2e591-a080-4d1e-94fd-1d4c035dbe25 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1225 microversion: 2.1 time: 0.095459 Jul 18 17:04:20.062080 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 688/1369] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:19 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:04:21.077383 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-152157ca-a814-4d2b-99e7-04b8515e97bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:21.077978 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-152157ca-a814-4d2b-99e7-04b8515e97bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:21.084637 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-152157ca-a814-4d2b-99e7-04b8515e97bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:21.085128 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-152157ca-a814-4d2b-99e7-04b8515e97bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:21.085897 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-152157ca-a814-4d2b-99e7-04b8515e97bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:21.086334 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-152157ca-a814-4d2b-99e7-04b8515e97bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:21.149844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-152157ca-a814-4d2b-99e7-04b8515e97bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:21.158660 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-152157ca-a814-4d2b-99e7-04b8515e97bb tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1225 microversion: 2.1 time: 0.085052 Jul 18 17:04:21.161377 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 682/1370] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:21 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:22.176222 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3aab03df-3e89-4470-a682-4eeab9eb4f78 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:22.176833 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3aab03df-3e89-4470-a682-4eeab9eb4f78 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:22.184289 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3aab03df-3e89-4470-a682-4eeab9eb4f78 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:22.184747 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3aab03df-3e89-4470-a682-4eeab9eb4f78 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:22.185705 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3aab03df-3e89-4470-a682-4eeab9eb4f78 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:22.186150 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3aab03df-3e89-4470-a682-4eeab9eb4f78 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:22.253114 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3aab03df-3e89-4470-a682-4eeab9eb4f78 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad27549c1824d45b1d55653e2c121a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c256859f2484e8465c043b3d2299d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:22.261117 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3aab03df-3e89-4470-a682-4eeab9eb4f78 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 200 len: 1225 microversion: 2.1 time: 0.088854 Jul 18 17:04:22.261975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 689/1371] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:22 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:23.280897 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d3d27509-41a3-4bcb-aa9a-657b816004bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:23.281540 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d3d27509-41a3-4bcb-aa9a-657b816004bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: e59d02fb-6042-4f0e-a98a-38c41602027a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:23.288142 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d3d27509-41a3-4bcb-aa9a-657b816004bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:23.288590 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d3d27509-41a3-4bcb-aa9a-657b816004bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:23.289490 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d3d27509-41a3-4bcb-aa9a-657b816004bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:23.289901 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d3d27509-41a3-4bcb-aa9a-657b816004bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:23.305361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-d3d27509-41a3-4bcb-aa9a-657b816004bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] HTTP exception thrown: Instance e59d02fb-6042-4f0e-a98a-38c41602027a could not be found. Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d3d27509-41a3-4bcb-aa9a-657b816004bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Request method failure captured: Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a HTTP/1.1 Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1ZAW45tf-ENfewcMUQEQN3d3TEIMWs_3d-y6pvASiuvpL6MwUL4uSy8Y0Acg2NzQG_BedrYuOQ2FRzude0kvF9E2LfOwcj-cTTFxdaL1F5nYNOs0AQWJwxm_Q_-4wc7oozlIpzXtOBSVrxIX_T_p4VHuKuaozxX02JrEaqWI093VWf8 Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 997c256859f2484e8465c043b3d2299d Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-TestVolumeBootPattern-626268263 Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:04:23.306926 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:04:23.309295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_997c256859f2484e8465c043b3d2299d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/997c256859f2484e8465c043b3d2299d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/997c256859f2484e8465c043b3d2299d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/997c256859f2484e8465c043b3d2299d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:23.309295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-TestVolumeBootPattern-626268263 Jul 18 17:04:23.309295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 997c256859f2484e8465c043b3d2299d Jul 18 17:04:23.309295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-TestVolumeBootPattern-626268263 Jul 18 17:04:23.309295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-TestVolumeBootPattern-626268263-project Jul 18 17:04:23.309295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:04:23.309295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:04:23.309295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 4ad27549c1824d45b1d55653e2c121a8 Jul 18 17:04:23.309295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-TestVolumeBootPattern-626268263-project Jul 18 17:04:23.309295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:04:23.309295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance e59d02fb-6042-4f0e-a98a-38c41602027a could not be found. Jul 18 17:04:23.309295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': 'e59d02fb-6042-4f0e-a98a-38c41602027a'} Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e59d02fb-6042-4f0e-a98a-38c41602027a could not be found. Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:23.310227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e59d02fb-6042-4f0e-a98a-38c41602027a could not be found. Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e59d02fb-6042-4f0e-a98a-38c41602027a could not be found. Jul 18 17:04:23.311736 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.313366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d3d27509-41a3-4bcb-aa9a-657b816004bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Returning 404 to user: Instance e59d02fb-6042-4f0e-a98a-38c41602027a could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:23.313366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d3d27509-41a3-4bcb-aa9a-657b816004bd tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a" status: 404 len: 111 microversion: 2.1 time: 0.033937 Jul 18 17:04:23.313366 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 683/1372] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:23 2022] GET /compute/v2.1/servers/e59d02fb-6042-4f0e-a98a-38c41602027a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:04:23.356169 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-006c38c7-77f2-4c4b-887b-8f8a18c67a8b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:23.360606 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-006c38c7-77f2-4c4b-887b-8f8a18c67a8b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:23.368248 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-006c38c7-77f2-4c4b-887b-8f8a18c67a8b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:23.368988 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-006c38c7-77f2-4c4b-887b-8f8a18c67a8b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:23.370956 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-006c38c7-77f2-4c4b-887b-8f8a18c67a8b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:23.371412 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-006c38c7-77f2-4c4b-887b-8f8a18c67a8b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:23.386666 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-006c38c7-77f2-4c4b-887b-8f8a18c67a8b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-006c38c7-77f2-4c4b-887b-8f8a18c67a8b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: DELETE /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee HTTP/1.1 Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 17:04:23.388591 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 17:04:23.390500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:23.390500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:23.390500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:23.390500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:23.390500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:23.390500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 17:04:23.390500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 17:04:23.390500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 17:04:23.390500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:23.390500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 17:04:23.390500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:23.390500 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': '79f024cc-89d3-458a-9095-be12de8d51ee'} Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:23.391939 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:23.395411 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.396699 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-006c38c7-77f2-4c4b-887b-8f8a18c67a8b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 404 to user: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:23.396699 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-006c38c7-77f2-4c4b-887b-8f8a18c67a8b tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 404 len: 111 microversion: 2.1 time: 0.038121 Jul 18 17:04:23.396699 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 690/1373] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:04:23 2022] DELETE /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:04:23.402043 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2b86e32c-ff35-4a38-bf3f-16a0299ba571 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:23.402672 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2b86e32c-ff35-4a38-bf3f-16a0299ba571 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 79f024cc-89d3-458a-9095-be12de8d51ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:23.408980 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2b86e32c-ff35-4a38-bf3f-16a0299ba571 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:23.409682 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2b86e32c-ff35-4a38-bf3f-16a0299ba571 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:23.410468 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2b86e32c-ff35-4a38-bf3f-16a0299ba571 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:23.410899 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2b86e32c-ff35-4a38-bf3f-16a0299ba571 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:23.425313 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-2b86e32c-ff35-4a38-bf3f-16a0299ba571 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2b86e32c-ff35-4a38-bf3f-16a0299ba571 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee HTTP/1.1 Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:04:23.426960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:04:23.428426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:23.428426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:23.428426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:23.428426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:23.428426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:23.428426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:04:23.428426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:04:23.428426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 17:04:23.428426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:23.428426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:04:23.428426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:23.428426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '79f024cc-89d3-458a-9095-be12de8d51ee'} Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:23.429275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. Jul 18 17:04:23.430566 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.431697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2b86e32c-ff35-4a38-bf3f-16a0299ba571 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 404 to user: Instance 79f024cc-89d3-458a-9095-be12de8d51ee could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:23.431697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2b86e32c-ff35-4a38-bf3f-16a0299ba571 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee" status: 404 len: 111 microversion: 2.1 time: 0.033627 Jul 18 17:04:23.431697 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 684/1374] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:23 2022] GET /compute/v2.1/servers/79f024cc-89d3-458a-9095-be12de8d51ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:04:23.491243 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-431000167", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:04:23.548652 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] validate_networks() for None {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:04:23.866997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:04:23.866997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:04:23.866997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:04:23.866997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:04:23.866997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:04:23.874613 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:23.875065 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:23.875921 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:23.876361 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:23.894751 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Getting quotas for project 1954560e876d4b1fbfec255b13ca7ba4. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:04:23.899350 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Getting quotas for user ab865b95180849e0aaf9eacb9eabc446 and project 1954560e876d4b1fbfec255b13ca7ba4. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:04:23.913636 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:04:23.917199 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:04:23.956898 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b54d0431-d43d-4f07-942e-eb0c314cfbe6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:23.957368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b54d0431-d43d-4f07-942e-eb0c314cfbe6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:23.963948 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b54d0431-d43d-4f07-942e-eb0c314cfbe6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:23.964929 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b54d0431-d43d-4f07-942e-eb0c314cfbe6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:23.965433 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b54d0431-d43d-4f07-942e-eb0c314cfbe6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:23.965867 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b54d0431-d43d-4f07-942e-eb0c314cfbe6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:23.980813 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-b54d0431-d43d-4f07-942e-eb0c314cfbe6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] HTTP exception thrown: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b54d0431-d43d-4f07-942e-eb0c314cfbe6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Request method failure captured: Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c HTTP/1.1 Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1ZAW45tf-ENfewcMUQEQN3d3TEIMWs_3d-y6pvASiuvpL6MwUL4uSy8Y0Acg2NzQG_BedrYuOQ2FRzude0kvF9E2LfOwcj-cTTFxdaL1F5nYNOs0AQWJwxm_Q_-4wc7oozlIpzXtOBSVrxIX_T_p4VHuKuaozxX02JrEaqWI093VWf8 Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 997c256859f2484e8465c043b3d2299d Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-TestVolumeBootPattern-626268263 Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:04:23.982388 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:04:23.984297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_997c256859f2484e8465c043b3d2299d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/997c256859f2484e8465c043b3d2299d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/997c256859f2484e8465c043b3d2299d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/997c256859f2484e8465c043b3d2299d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:23.984297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-TestVolumeBootPattern-626268263 Jul 18 17:04:23.984297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 997c256859f2484e8465c043b3d2299d Jul 18 17:04:23.984297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-TestVolumeBootPattern-626268263 Jul 18 17:04:23.984297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-TestVolumeBootPattern-626268263-project Jul 18 17:04:23.984297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:04:23.984297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:04:23.984297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 4ad27549c1824d45b1d55653e2c121a8 Jul 18 17:04:23.984297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-TestVolumeBootPattern-626268263-project Jul 18 17:04:23.984297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:04:23.984297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 17:04:23.984297 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '11140d5e-70e4-4716-ac6c-cef98b91640c'} Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:23.985295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 17:04:23.986826 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:23.988252 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b54d0431-d43d-4f07-942e-eb0c314cfbe6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Returning 404 to user: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:23.988252 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b54d0431-d43d-4f07-942e-eb0c314cfbe6 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "DELETE /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 404 len: 111 microversion: 2.1 time: 0.031079 Jul 18 17:04:23.988252 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 685/1375] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:04:23 2022] DELETE /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:04:23.992641 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fa47715e-d7b9-43b8-893e-97ffe5b01567 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:23.993277 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fa47715e-d7b9-43b8-893e-97ffe5b01567 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] [instance: 11140d5e-70e4-4716-ac6c-cef98b91640c] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:23.999340 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa47715e-d7b9-43b8-893e-97ffe5b01567 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:23.999784 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa47715e-d7b9-43b8-893e-97ffe5b01567 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:24.000531 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa47715e-d7b9-43b8-893e-97ffe5b01567 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:24.000960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa47715e-d7b9-43b8-893e-97ffe5b01567 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:24.014684 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-fa47715e-d7b9-43b8-893e-97ffe5b01567 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] HTTP exception thrown: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fa47715e-d7b9-43b8-893e-97ffe5b01567 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Request method failure captured: Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c HTTP/1.1 Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1ZAW45tf-ENfewcMUQEQN3d3TEIMWs_3d-y6pvASiuvpL6MwUL4uSy8Y0Acg2NzQG_BedrYuOQ2FRzude0kvF9E2LfOwcj-cTTFxdaL1F5nYNOs0AQWJwxm_Q_-4wc7oozlIpzXtOBSVrxIX_T_p4VHuKuaozxX02JrEaqWI093VWf8 Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 997c256859f2484e8465c043b3d2299d Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-TestVolumeBootPattern-626268263 Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:04:24.016245 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:04:24.017888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_997c256859f2484e8465c043b3d2299d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/997c256859f2484e8465c043b3d2299d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/997c256859f2484e8465c043b3d2299d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/997c256859f2484e8465c043b3d2299d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:24.017888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-TestVolumeBootPattern-626268263 Jul 18 17:04:24.017888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 997c256859f2484e8465c043b3d2299d Jul 18 17:04:24.017888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-TestVolumeBootPattern-626268263 Jul 18 17:04:24.017888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-TestVolumeBootPattern-626268263-project Jul 18 17:04:24.017888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:04:24.017888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:04:24.017888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 4ad27549c1824d45b1d55653e2c121a8 Jul 18 17:04:24.017888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-TestVolumeBootPattern-626268263-project Jul 18 17:04:24.017888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:04:24.017888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 17:04:24.017888 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '11140d5e-70e4-4716-ac6c-cef98b91640c'} Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:24.018741 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. Jul 18 17:04:24.020088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.021393 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fa47715e-d7b9-43b8-893e-97ffe5b01567 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Returning 404 to user: Instance 11140d5e-70e4-4716-ac6c-cef98b91640c could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:24.021393 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fa47715e-d7b9-43b8-893e-97ffe5b01567 tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c" status: 404 len: 111 microversion: 2.1 time: 0.028760 Jul 18 17:04:24.021393 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 686/1376] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:23 2022] GET /compute/v2.1/servers/11140d5e-70e4-4716-ac6c-cef98b91640c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:04:24.062756 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [463732dc-4ad9-44ee-a0b9-b166cb5469b7] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 17:04:24.736549 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7ee5fbd1-728b-4f93-9a00-a4f0d5584ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:24.737354 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7ee5fbd1-728b-4f93-9a00-a4f0d5584ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:24.744140 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ee5fbd1-728b-4f93-9a00-a4f0d5584ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:24.745134 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ee5fbd1-728b-4f93-9a00-a4f0d5584ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:24.746650 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ee5fbd1-728b-4f93-9a00-a4f0d5584ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:24.747275 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ee5fbd1-728b-4f93-9a00-a4f0d5584ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:24.765397 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-7ee5fbd1-728b-4f93-9a00-a4f0d5584ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7ee5fbd1-728b-4f93-9a00-a4f0d5584ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 HTTP/1.1 Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:04:24.767201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:04:24.776053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:24.776053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:24.776053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:24.776053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:24.776053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:24.776053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:04:24.776053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:04:24.776053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 17:04:24.776053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:24.776053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:04:24.776053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:04:24.776053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': 'e8d0d7ca-fd48-4083-9569-18fb20c564a9'} Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:24.777144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:04:24.778644 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.780144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7ee5fbd1-728b-4f93-9a00-a4f0d5584ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 404 to user: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:24.780144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7ee5fbd1-728b-4f93-9a00-a4f0d5584ff4 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 404 len: 111 microversion: 2.1 time: 0.037807 Jul 18 17:04:24.780144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 687/1377] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:04:24 2022] DELETE /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:04:24.780144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-51101a8a-a9f4-48ab-b5cb-f3c03ff5e1c5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:24.780144 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-51101a8a-a9f4-48ab-b5cb-f3c03ff5e1c5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: e8d0d7ca-fd48-4083-9569-18fb20c564a9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:24.786181 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-51101a8a-a9f4-48ab-b5cb-f3c03ff5e1c5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:24.786696 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-51101a8a-a9f4-48ab-b5cb-f3c03ff5e1c5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:24.787451 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-51101a8a-a9f4-48ab-b5cb-f3c03ff5e1c5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:24.787876 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-51101a8a-a9f4-48ab-b5cb-f3c03ff5e1c5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:24.801919 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-51101a8a-a9f4-48ab-b5cb-f3c03ff5e1c5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-51101a8a-a9f4-48ab-b5cb-f3c03ff5e1c5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 HTTP/1.1 Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:04:24.803470 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:04:24.805150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:24.805150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:24.805150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:24.805150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:24.805150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:24.805150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:04:24.805150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:04:24.805150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 17:04:24.805150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:24.805150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:04:24.805150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:04:24.805150 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': 'e8d0d7ca-fd48-4083-9569-18fb20c564a9'} Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:24.806107 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. Jul 18 17:04:24.808695 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.810057 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-51101a8a-a9f4-48ab-b5cb-f3c03ff5e1c5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 404 to user: Instance e8d0d7ca-fd48-4083-9569-18fb20c564a9 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:24.810057 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-51101a8a-a9f4-48ab-b5cb-f3c03ff5e1c5 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9" status: 404 len: 111 microversion: 2.1 time: 0.029862 Jul 18 17:04:24.810057 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 688/1378] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:24 2022] GET /compute/v2.1/servers/e8d0d7ca-fd48-4083-9569-18fb20c564a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:04:24.813579 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-88124f95-7e80-4827-af2a-105b5326cb3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:24.814077 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-88124f95-7e80-4827-af2a-105b5326cb3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:24.820069 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88124f95-7e80-4827-af2a-105b5326cb3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:24.820518 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88124f95-7e80-4827-af2a-105b5326cb3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:24.821356 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88124f95-7e80-4827-af2a-105b5326cb3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:24.821787 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-88124f95-7e80-4827-af2a-105b5326cb3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:24.836214 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-88124f95-7e80-4827-af2a-105b5326cb3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-88124f95-7e80-4827-af2a-105b5326cb3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 HTTP/1.1 Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:04:24.837788 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:04:24.839462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:24.839462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:24.839462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:24.839462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:24.839462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:24.839462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:04:24.839462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:04:24.839462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 17:04:24.839462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:24.839462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:04:24.839462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 17:04:24.839462 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '0a961f74-97c0-4862-a288-ff06a9aa55e9'} Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:24.840402 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 17:04:24.841891 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.843473 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-88124f95-7e80-4827-af2a-105b5326cb3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 404 to user: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:24.843473 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-88124f95-7e80-4827-af2a-105b5326cb3e tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 404 len: 111 microversion: 2.1 time: 0.029392 Jul 18 17:04:24.843473 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 689/1379] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:04:24 2022] DELETE /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:04:24.848114 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d9545474-7f2c-4de3-aea2-da5577a0a786 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:24.848723 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d9545474-7f2c-4de3-aea2-da5577a0a786 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: 0a961f74-97c0-4862-a288-ff06a9aa55e9] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:24.854890 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d9545474-7f2c-4de3-aea2-da5577a0a786 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:24.855448 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d9545474-7f2c-4de3-aea2-da5577a0a786 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:24.856223 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d9545474-7f2c-4de3-aea2-da5577a0a786 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:24.856659 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d9545474-7f2c-4de3-aea2-da5577a0a786 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:24.871373 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-d9545474-7f2c-4de3-aea2-da5577a0a786 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d9545474-7f2c-4de3-aea2-da5577a0a786 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 HTTP/1.1 Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:04:24.872913 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:04:24.874537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:24.874537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:24.874537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:24.874537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:24.874537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:24.874537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:04:24.874537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:04:24.874537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 17:04:24.874537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:24.874537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:04:24.874537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 17:04:24.874537 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '0a961f74-97c0-4862-a288-ff06a9aa55e9'} Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:24.875296 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. Jul 18 17:04:24.876544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:24.883171 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d9545474-7f2c-4de3-aea2-da5577a0a786 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 404 to user: Instance 0a961f74-97c0-4862-a288-ff06a9aa55e9 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:24.883171 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d9545474-7f2c-4de3-aea2-da5577a0a786 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9" status: 404 len: 111 microversion: 2.1 time: 0.029765 Jul 18 17:04:24.883171 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 690/1380] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:24 2022] GET /compute/v2.1/servers/0a961f74-97c0-4862-a288-ff06a9aa55e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:04:25.069704 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO oslo.messaging._drivers.impl_rabbit [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [463732dc-4ad9-44ee-a0b9-b166cb5469b7] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 36758. Jul 18 17:04:25.074633 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7dd75df1-a2eb-4c69-92c1-112479ff9dcb tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.587370 Jul 18 17:04:25.075568 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 691/1381] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 17:04:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 17:04:25.085539 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-33af60a7-e888-48d4-8770-f507a2827a63 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:25.086157 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-33af60a7-e888-48d4-8770-f507a2827a63 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:25.143088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-33af60a7-e888-48d4-8770-f507a2827a63 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:25.149975 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-33af60a7-e888-48d4-8770-f507a2827a63 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1214 microversion: 2.1 time: 0.068203 Jul 18 17:04:25.150540 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 691/1382] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:25 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:25.497917 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1438d454-2cd6-4a60-8bf5-ab698bcf3b9e tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] Calling method '.version_select at 0x7f4af16e09d0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:25.573220 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1438d454-2cd6-4a60-8bf5-ab698bcf3b9e tempest-TestVolumeBootPattern-626268263 tempest-TestVolumeBootPattern-626268263-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1291189408" status: 202 len: 0 microversion: 2.1 time: 0.079768 Jul 18 17:04:25.573731 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 692/1383] 10.222.0.76 () {58 vars in 1262 bytes} [Mon Jul 18 17:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1291189408 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:04:26.167674 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-94d0cb5d-9eb5-42d9-8121-bb6b8d637c0f tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:26.168333 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-94d0cb5d-9eb5-42d9-8121-bb6b8d637c0f tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:26.285323 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-94d0cb5d-9eb5-42d9-8121-bb6b8d637c0f tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:26.292403 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-94d0cb5d-9eb5-42d9-8121-bb6b8d637c0f tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1214 microversion: 2.1 time: 0.128575 Jul 18 17:04:26.293285 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 692/1384] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:26 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:27.310997 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-44e7faaa-8872-4d58-b58d-435071a3309c tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:27.311618 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-44e7faaa-8872-4d58-b58d-435071a3309c tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:27.373316 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-44e7faaa-8872-4d58-b58d-435071a3309c tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:27.387879 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-44e7faaa-8872-4d58-b58d-435071a3309c tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1214 microversion: 2.1 time: 0.081875 Jul 18 17:04:27.390672 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 693/1385] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:27 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:28.408418 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7de964ab-1ff8-41bb-94f7-47bc8e7ce107 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:28.409051 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7de964ab-1ff8-41bb-94f7-47bc8e7ce107 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:28.411731 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:28.470821 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7de964ab-1ff8-41bb-94f7-47bc8e7ce107 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:28.477925 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7de964ab-1ff8-41bb-94f7-47bc8e7ce107 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1214 microversion: 2.1 time: 0.073379 Jul 18 17:04:28.478614 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 693/1386] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:28 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:29.497431 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-651b300c-1c0d-4d1c-bfb6-268afa1e8cb8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:29.498757 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-651b300c-1c0d-4d1c-bfb6-268afa1e8cb8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:29.501680 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:29.507258 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-651b300c-1c0d-4d1c-bfb6-268afa1e8cb8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:29.507637 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-651b300c-1c0d-4d1c-bfb6-268afa1e8cb8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:29.508413 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-651b300c-1c0d-4d1c-bfb6-268afa1e8cb8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:29.508866 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-651b300c-1c0d-4d1c-bfb6-268afa1e8cb8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:29.574778 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-651b300c-1c0d-4d1c-bfb6-268afa1e8cb8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:29.582496 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-651b300c-1c0d-4d1c-bfb6-268afa1e8cb8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1218 microversion: 2.1 time: 0.090217 Jul 18 17:04:29.583954 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 694/1387] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:29 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:30.600072 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5ff3f8dc-927e-4637-95f0-3284b221c58f tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:30.601099 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5ff3f8dc-927e-4637-95f0-3284b221c58f tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:30.610070 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5ff3f8dc-927e-4637-95f0-3284b221c58f tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:30.610642 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5ff3f8dc-927e-4637-95f0-3284b221c58f tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:30.611595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5ff3f8dc-927e-4637-95f0-3284b221c58f tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:30.612042 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5ff3f8dc-927e-4637-95f0-3284b221c58f tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:30.694793 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5ff3f8dc-927e-4637-95f0-3284b221c58f tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:30.703839 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5ff3f8dc-927e-4637-95f0-3284b221c58f tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1218 microversion: 2.1 time: 0.107757 Jul 18 17:04:30.713375 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 694/1388] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:30 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:31.501053 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-309ca1ee-95f8-464e-8ab3-83c0e4bb4df7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:31.501818 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-309ca1ee-95f8-464e-8ab3-83c0e4bb4df7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:31.508641 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-309ca1ee-95f8-464e-8ab3-83c0e4bb4df7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:31.509160 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-309ca1ee-95f8-464e-8ab3-83c0e4bb4df7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:31.510058 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-309ca1ee-95f8-464e-8ab3-83c0e4bb4df7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:31.511255 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-309ca1ee-95f8-464e-8ab3-83c0e4bb4df7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:31.527399 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-309ca1ee-95f8-464e-8ab3-83c0e4bb4df7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-309ca1ee-95f8-464e-8ab3-83c0e4bb4df7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: DELETE /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd HTTP/1.1 Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 17:04:31.529192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 17:04:31.532311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:31.532311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:31.532311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:31.532311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:31.532311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:31.532311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 17:04:31.532311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 17:04:31.532311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 17:04:31.532311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:31.532311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 17:04:31.532311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 17:04:31.532311 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': 'b57c0d06-7394-47d2-ab8b-2445e996c9bd'} Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:31.535005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 17:04:31.539162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:04:31.549525 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-309ca1ee-95f8-464e-8ab3-83c0e4bb4df7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 404 to user: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:31.549525 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-309ca1ee-95f8-464e-8ab3-83c0e4bb4df7 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 404 len: 111 microversion: 2.1 time: 0.036035 Jul 18 17:04:31.549525 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 695/1389] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:04:31 2022] DELETE /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:04:31.550443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b1512a96-9595-4368-90ba-47d3bf85e421 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:31.550443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b1512a96-9595-4368-90ba-47d3bf85e421 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] [instance: b57c0d06-7394-47d2-ab8b-2445e996c9bd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:31.561721 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b1512a96-9595-4368-90ba-47d3bf85e421 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:31.562175 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b1512a96-9595-4368-90ba-47d3bf85e421 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:31.562971 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b1512a96-9595-4368-90ba-47d3bf85e421 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:31.563416 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b1512a96-9595-4368-90ba-47d3bf85e421 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:31.578525 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-b1512a96-9595-4368-90ba-47d3bf85e421 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] HTTP exception thrown: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b1512a96-9595-4368-90ba-47d3bf85e421 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Request method failure captured: Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd HTTP/1.1 Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1Y-UPkkMROeRjxha7QHdqrE7p3mSAbwLcTmKCsj4kviqLUDha-0xRwlUxsykc0FB0hI1tLLs4Z5E1viHv6nYj-o3sqGzIKG3Ea-XkK6QwdILrBweK478LNrrk14318hCSP1TYf2uLEOxXRO22lOHBhLFazyu7ttiHtXGu8WW--kk15s Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:04:31.580095 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:04:31.581857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4f82344d2255427582cc29e253b37f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4f82344d2255427582cc29e253b37f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:31.581857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:31.581857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 4f82344d2255427582cc29e253b37f0b Jul 18 17:04:31.581857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1190740591 Jul 18 17:04:31.581857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:31.581857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:04:31.581857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:04:31.581857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 0cf277a2d03443c8af7a7bee2731d9d1 Jul 18 17:04:31.581857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-1190740591-project Jul 18 17:04:31.581857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:04:31.581857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 17:04:31.581857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': 'b57c0d06-7394-47d2-ab8b-2445e996c9bd'} Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:31.582857 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. Jul 18 17:04:31.584368 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:31.585731 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b1512a96-9595-4368-90ba-47d3bf85e421 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] Returning 404 to user: Instance b57c0d06-7394-47d2-ab8b-2445e996c9bd could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:31.585731 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b1512a96-9595-4368-90ba-47d3bf85e421 tempest-AttachVolumeNegativeTest-1190740591 tempest-AttachVolumeNegativeTest-1190740591-project] 10.222.0.76 "GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd" status: 404 len: 111 microversion: 2.1 time: 0.044816 Jul 18 17:04:31.585731 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 695/1390] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:31 2022] GET /compute/v2.1/servers/b57c0d06-7394-47d2-ab8b-2445e996c9bd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:04:31.730525 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7197a77b-2e50-4904-8ebe-1f4387c47e48 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:31.731505 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7197a77b-2e50-4904-8ebe-1f4387c47e48 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:31.739492 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7197a77b-2e50-4904-8ebe-1f4387c47e48 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:31.740282 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7197a77b-2e50-4904-8ebe-1f4387c47e48 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:31.741563 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7197a77b-2e50-4904-8ebe-1f4387c47e48 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:31.742288 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7197a77b-2e50-4904-8ebe-1f4387c47e48 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:32.161722 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7197a77b-2e50-4904-8ebe-1f4387c47e48 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:32.194227 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7197a77b-2e50-4904-8ebe-1f4387c47e48 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1266 microversion: 2.1 time: 0.470259 Jul 18 17:04:32.195628 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 696/1391] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:31 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1266 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:33.217617 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-50bfd8ce-9459-43a8-8a20-4b6602cc2c15 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:33.218406 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-50bfd8ce-9459-43a8-8a20-4b6602cc2c15 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:33.231813 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50bfd8ce-9459-43a8-8a20-4b6602cc2c15 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:33.232486 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50bfd8ce-9459-43a8-8a20-4b6602cc2c15 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:33.233364 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50bfd8ce-9459-43a8-8a20-4b6602cc2c15 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:33.234137 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50bfd8ce-9459-43a8-8a20-4b6602cc2c15 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:33.344159 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-50bfd8ce-9459-43a8-8a20-4b6602cc2c15 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:33.356357 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-50bfd8ce-9459-43a8-8a20-4b6602cc2c15 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1272 microversion: 2.1 time: 0.143010 Jul 18 17:04:33.357740 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 696/1392] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:33 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:34.382723 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-db978fa3-adb0-4041-b4af-48db2cc33fe9 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:34.383731 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-db978fa3-adb0-4041-b4af-48db2cc33fe9 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:34.388232 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:34.393034 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-db978fa3-adb0-4041-b4af-48db2cc33fe9 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:34.394266 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-db978fa3-adb0-4041-b4af-48db2cc33fe9 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:34.395307 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-db978fa3-adb0-4041-b4af-48db2cc33fe9 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:34.395965 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-db978fa3-adb0-4041-b4af-48db2cc33fe9 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:34.727890 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-db978fa3-adb0-4041-b4af-48db2cc33fe9 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:34.741405 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-db978fa3-adb0-4041-b4af-48db2cc33fe9 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1314 microversion: 2.1 time: 0.364676 Jul 18 17:04:34.753946 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 697/1393] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:34 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:35.075882 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-43071f21-782d-4289-b21e-81ce2670313b req-a801a359-7dba-4eb1-b323-973afa6aa052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1413acf9-9036-4fab-9039-1270de6b46d1", "tag": "e9f4f356-d4cb-420c-a385-2e4f09a60957"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:04:35.091981 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-43071f21-782d-4289-b21e-81ce2670313b req-a801a359-7dba-4eb1-b323-973afa6aa052 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:35.093070 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-43071f21-782d-4289-b21e-81ce2670313b req-a801a359-7dba-4eb1-b323-973afa6aa052 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:35.121608 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-43071f21-782d-4289-b21e-81ce2670313b req-a801a359-7dba-4eb1-b323-973afa6aa052 service nova] Creating event network-changed:e9f4f356-d4cb-420c-a385-2e4f09a60957 for instance 1413acf9-9036-4fab-9039-1270de6b46d1 on hv-cinder-83754 Jul 18 17:04:35.132824 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-43071f21-782d-4289-b21e-81ce2670313b req-a801a359-7dba-4eb1-b323-973afa6aa052 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058832 Jul 18 17:04:35.134365 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 697/1394] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:04:35.765912 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ab75c38f-9b5b-421e-a6a1-d20e697fcffa tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:35.770690 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ab75c38f-9b5b-421e-a6a1-d20e697fcffa tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:35.779009 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ab75c38f-9b5b-421e-a6a1-d20e697fcffa tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:35.779563 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ab75c38f-9b5b-421e-a6a1-d20e697fcffa tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:35.780325 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ab75c38f-9b5b-421e-a6a1-d20e697fcffa tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:35.780821 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ab75c38f-9b5b-421e-a6a1-d20e697fcffa tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:36.069603 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ab75c38f-9b5b-421e-a6a1-d20e697fcffa tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:36.081325 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ab75c38f-9b5b-421e-a6a1-d20e697fcffa tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1314 microversion: 2.1 time: 0.324150 Jul 18 17:04:36.092192 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 698/1395] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:35 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:37.100511 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f0daa2b3-2d77-4ed1-8f7d-6c5fb11cf287 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:37.101284 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f0daa2b3-2d77-4ed1-8f7d-6c5fb11cf287 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:37.109097 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f0daa2b3-2d77-4ed1-8f7d-6c5fb11cf287 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:37.109633 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f0daa2b3-2d77-4ed1-8f7d-6c5fb11cf287 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:37.110472 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f0daa2b3-2d77-4ed1-8f7d-6c5fb11cf287 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:37.110973 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f0daa2b3-2d77-4ed1-8f7d-6c5fb11cf287 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:37.295045 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f0daa2b3-2d77-4ed1-8f7d-6c5fb11cf287 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:37.309942 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f0daa2b3-2d77-4ed1-8f7d-6c5fb11cf287 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1314 microversion: 2.1 time: 0.213978 Jul 18 17:04:37.310722 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 698/1396] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:37 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:38.327960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cbe6b4d1-1a3b-48c6-a064-929cc608c926 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:38.328575 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cbe6b4d1-1a3b-48c6-a064-929cc608c926 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:38.330975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=8 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:38.336872 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cbe6b4d1-1a3b-48c6-a064-929cc608c926 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:38.339142 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cbe6b4d1-1a3b-48c6-a064-929cc608c926 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:38.339142 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cbe6b4d1-1a3b-48c6-a064-929cc608c926 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:38.339420 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cbe6b4d1-1a3b-48c6-a064-929cc608c926 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:38.481579 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cbe6b4d1-1a3b-48c6-a064-929cc608c926 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:38.486268 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cbe6b4d1-1a3b-48c6-a064-929cc608c926 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1314 microversion: 2.1 time: 0.162189 Jul 18 17:04:38.486893 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 699/1397] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:38 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:39.503622 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-23115dc7-f560-4116-9da1-6245d32767d5 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:39.504386 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-23115dc7-f560-4116-9da1-6245d32767d5 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:39.511972 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=6 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:39.517244 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23115dc7-f560-4116-9da1-6245d32767d5 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:39.517709 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23115dc7-f560-4116-9da1-6245d32767d5 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:39.518524 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23115dc7-f560-4116-9da1-6245d32767d5 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:39.519022 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23115dc7-f560-4116-9da1-6245d32767d5 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:39.676248 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-23115dc7-f560-4116-9da1-6245d32767d5 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:39.684863 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-23115dc7-f560-4116-9da1-6245d32767d5 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1314 microversion: 2.1 time: 0.185108 Jul 18 17:04:39.685460 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 699/1398] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:39 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:40.702279 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5511e490-f81f-4cef-82c0-174fafb711bf tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:40.702915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5511e490-f81f-4cef-82c0-174fafb711bf tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:40.710137 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5511e490-f81f-4cef-82c0-174fafb711bf tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:40.710993 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5511e490-f81f-4cef-82c0-174fafb711bf tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:40.712320 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5511e490-f81f-4cef-82c0-174fafb711bf tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:40.713084 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5511e490-f81f-4cef-82c0-174fafb711bf tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:40.864365 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5511e490-f81f-4cef-82c0-174fafb711bf tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:40.873572 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5511e490-f81f-4cef-82c0-174fafb711bf tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1314 microversion: 2.1 time: 0.175166 Jul 18 17:04:40.874162 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 700/1399] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:40 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:04:41.892116 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-70d62164-b3b1-41d1-a1d2-90bb718635fe tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:41.894276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-70d62164-b3b1-41d1-a1d2-90bb718635fe tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:41.903433 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-70d62164-b3b1-41d1-a1d2-90bb718635fe tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:41.904029 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-70d62164-b3b1-41d1-a1d2-90bb718635fe tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:41.904920 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-70d62164-b3b1-41d1-a1d2-90bb718635fe tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:41.905649 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-70d62164-b3b1-41d1-a1d2-90bb718635fe tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:42.059323 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-70d62164-b3b1-41d1-a1d2-90bb718635fe tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:42.066896 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-70d62164-b3b1-41d1-a1d2-90bb718635fe tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1314 microversion: 2.1 time: 0.179085 Jul 18 17:04:42.067555 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 700/1400] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:41 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:43.084110 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f64beb67-f13e-48c2-97dc-6ef3dbb944ac tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:43.085225 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f64beb67-f13e-48c2-97dc-6ef3dbb944ac tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:43.093316 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f64beb67-f13e-48c2-97dc-6ef3dbb944ac tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:43.093763 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f64beb67-f13e-48c2-97dc-6ef3dbb944ac tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:43.094561 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f64beb67-f13e-48c2-97dc-6ef3dbb944ac tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:43.095012 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f64beb67-f13e-48c2-97dc-6ef3dbb944ac tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:43.262407 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f64beb67-f13e-48c2-97dc-6ef3dbb944ac tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:43.270038 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f64beb67-f13e-48c2-97dc-6ef3dbb944ac tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1314 microversion: 2.1 time: 0.189844 Jul 18 17:04:43.270615 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 701/1401] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:43 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:43.568997 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-9dcbe849-28cb-49dc-8a13-e4224ca00033 req-ae00568e-6933-41a0-9849-fde48a56b200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1413acf9-9036-4fab-9039-1270de6b46d1", "name": "network-vif-plugged", "status": "completed", "tag": "e9f4f356-d4cb-420c-a385-2e4f09a60957"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:04:43.576980 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-9dcbe849-28cb-49dc-8a13-e4224ca00033 req-ae00568e-6933-41a0-9849-fde48a56b200 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:43.577457 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-9dcbe849-28cb-49dc-8a13-e4224ca00033 req-ae00568e-6933-41a0-9849-fde48a56b200 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:43.590195 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-9dcbe849-28cb-49dc-8a13-e4224ca00033 req-ae00568e-6933-41a0-9849-fde48a56b200 service nova] Creating event network-vif-plugged:e9f4f356-d4cb-420c-a385-2e4f09a60957 for instance 1413acf9-9036-4fab-9039-1270de6b46d1 on hv-cinder-83754 Jul 18 17:04:43.595507 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-9dcbe849-28cb-49dc-8a13-e4224ca00033 req-ae00568e-6933-41a0-9849-fde48a56b200 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160872 Jul 18 17:04:43.596123 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 701/1402] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:04:44.287823 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5d5d2758-71ab-42cd-a53f-2fa9fa6f3173 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:44.288547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5d5d2758-71ab-42cd-a53f-2fa9fa6f3173 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:44.296547 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d5d2758-71ab-42cd-a53f-2fa9fa6f3173 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:44.297030 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d5d2758-71ab-42cd-a53f-2fa9fa6f3173 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:44.297832 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d5d2758-71ab-42cd-a53f-2fa9fa6f3173 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:44.298281 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d5d2758-71ab-42cd-a53f-2fa9fa6f3173 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:44.435783 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5d5d2758-71ab-42cd-a53f-2fa9fa6f3173 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:44.443407 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5d5d2758-71ab-42cd-a53f-2fa9fa6f3173 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1314 microversion: 2.1 time: 0.159589 Jul 18 17:04:44.443967 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 702/1403] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:44 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:45.461932 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-10d28eef-155e-48fc-be4e-5030705f52db tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:45.462656 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-10d28eef-155e-48fc-be4e-5030705f52db tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:45.469802 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10d28eef-155e-48fc-be4e-5030705f52db tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:45.470291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10d28eef-155e-48fc-be4e-5030705f52db tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:45.471072 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10d28eef-155e-48fc-be4e-5030705f52db tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:45.471514 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10d28eef-155e-48fc-be4e-5030705f52db tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:45.618003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-10d28eef-155e-48fc-be4e-5030705f52db tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:45.627428 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-10d28eef-155e-48fc-be4e-5030705f52db tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1314 microversion: 2.1 time: 0.169804 Jul 18 17:04:45.628197 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 702/1404] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:45 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:04:46.646587 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-195b35f7-19dc-44d1-8352-84b4502d269a tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:46.647198 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-195b35f7-19dc-44d1-8352-84b4502d269a tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:46.654957 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-195b35f7-19dc-44d1-8352-84b4502d269a tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:46.655410 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-195b35f7-19dc-44d1-8352-84b4502d269a tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:46.656191 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-195b35f7-19dc-44d1-8352-84b4502d269a tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:46.656633 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-195b35f7-19dc-44d1-8352-84b4502d269a tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:46.792746 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-195b35f7-19dc-44d1-8352-84b4502d269a tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:46.802099 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-195b35f7-19dc-44d1-8352-84b4502d269a tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1464 microversion: 2.1 time: 0.160133 Jul 18 17:04:46.802801 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 703/1405] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:46 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:04:46.842544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2aa68999-2482-4c3d-8c7c-63f4bd7312ee tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:46.843084 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2aa68999-2482-4c3d-8c7c-63f4bd7312ee tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:46.849502 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2aa68999-2482-4c3d-8c7c-63f4bd7312ee tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:46.849944 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2aa68999-2482-4c3d-8c7c-63f4bd7312ee tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:46.850726 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2aa68999-2482-4c3d-8c7c-63f4bd7312ee tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:46.851160 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2aa68999-2482-4c3d-8c7c-63f4bd7312ee tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:46.878579 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2aa68999-2482-4c3d-8c7c-63f4bd7312ee tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:04:47.188615 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2aa68999-2482-4c3d-8c7c-63f4bd7312ee tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 204 len: 0 microversion: 2.1 time: 0.349523 Jul 18 17:04:47.189300 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 703/1406] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:04:46 2022] DELETE /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:04:47.198184 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2037cbeb-3b78-49cf-a48e-93108f0db577 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:47.198888 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2037cbeb-3b78-49cf-a48e-93108f0db577 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:47.209837 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2037cbeb-3b78-49cf-a48e-93108f0db577 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:47.209837 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2037cbeb-3b78-49cf-a48e-93108f0db577 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:47.209837 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2037cbeb-3b78-49cf-a48e-93108f0db577 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:47.212038 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2037cbeb-3b78-49cf-a48e-93108f0db577 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:47.345740 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2037cbeb-3b78-49cf-a48e-93108f0db577 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:47.354014 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2037cbeb-3b78-49cf-a48e-93108f0db577 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1470 microversion: 2.1 time: 0.159811 Jul 18 17:04:47.355176 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 704/1407] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:47 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:04:48.373400 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1a44d2d7-7b94-4c54-859d-e57b069371e7 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:48.374051 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1a44d2d7-7b94-4c54-859d-e57b069371e7 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:48.380628 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1a44d2d7-7b94-4c54-859d-e57b069371e7 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:48.381111 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1a44d2d7-7b94-4c54-859d-e57b069371e7 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:48.381966 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1a44d2d7-7b94-4c54-859d-e57b069371e7 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:48.382409 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1a44d2d7-7b94-4c54-859d-e57b069371e7 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:48.386863 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:48.519079 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1a44d2d7-7b94-4c54-859d-e57b069371e7 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:48.527401 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1a44d2d7-7b94-4c54-859d-e57b069371e7 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1470 microversion: 2.1 time: 0.159204 Jul 18 17:04:48.527977 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 704/1408] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:48 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:49.544916 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b3d3fec4-a5b5-4167-af8b-18a00bcf3ea0 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:49.545553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b3d3fec4-a5b5-4167-af8b-18a00bcf3ea0 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:49.551561 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b3d3fec4-a5b5-4167-af8b-18a00bcf3ea0 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:49.552007 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b3d3fec4-a5b5-4167-af8b-18a00bcf3ea0 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:49.552769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b3d3fec4-a5b5-4167-af8b-18a00bcf3ea0 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:49.553235 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b3d3fec4-a5b5-4167-af8b-18a00bcf3ea0 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:49.690125 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b3d3fec4-a5b5-4167-af8b-18a00bcf3ea0 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:49.699023 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b3d3fec4-a5b5-4167-af8b-18a00bcf3ea0 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1470 microversion: 2.1 time: 0.158154 Jul 18 17:04:49.699597 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 705/1409] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:49 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:50.717487 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ea26f183-e3c2-4228-bec3-8f0ad2a27965 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:50.718076 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ea26f183-e3c2-4228-bec3-8f0ad2a27965 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:50.724846 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea26f183-e3c2-4228-bec3-8f0ad2a27965 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:50.725331 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea26f183-e3c2-4228-bec3-8f0ad2a27965 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:50.726374 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea26f183-e3c2-4228-bec3-8f0ad2a27965 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:50.726795 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea26f183-e3c2-4228-bec3-8f0ad2a27965 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:50.864940 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ea26f183-e3c2-4228-bec3-8f0ad2a27965 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:50.873485 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ea26f183-e3c2-4228-bec3-8f0ad2a27965 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1470 microversion: 2.1 time: 0.160198 Jul 18 17:04:50.874055 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 705/1410] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:50 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:51.891842 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-669358fb-1dfc-4794-a3cb-6fdf3203de77 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:51.892427 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-669358fb-1dfc-4794-a3cb-6fdf3203de77 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:51.899185 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-669358fb-1dfc-4794-a3cb-6fdf3203de77 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:51.899768 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-669358fb-1dfc-4794-a3cb-6fdf3203de77 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:51.900446 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-669358fb-1dfc-4794-a3cb-6fdf3203de77 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:51.900879 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-669358fb-1dfc-4794-a3cb-6fdf3203de77 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:51.903529 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=88 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:52.035043 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-669358fb-1dfc-4794-a3cb-6fdf3203de77 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:52.043229 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-669358fb-1dfc-4794-a3cb-6fdf3203de77 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1470 microversion: 2.1 time: 0.155327 Jul 18 17:04:52.043793 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 706/1411] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:51 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:53.064452 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6131c46c-99d2-4f6d-973c-c272056a3cc8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:53.065472 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6131c46c-99d2-4f6d-973c-c272056a3cc8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:53.074041 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6131c46c-99d2-4f6d-973c-c272056a3cc8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:53.074487 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6131c46c-99d2-4f6d-973c-c272056a3cc8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:53.075286 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6131c46c-99d2-4f6d-973c-c272056a3cc8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:53.075714 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6131c46c-99d2-4f6d-973c-c272056a3cc8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:53.218656 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6131c46c-99d2-4f6d-973c-c272056a3cc8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:53.226324 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6131c46c-99d2-4f6d-973c-c272056a3cc8 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1470 microversion: 2.1 time: 0.169193 Jul 18 17:04:53.227042 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 706/1412] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:53 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:54.243834 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f09e8ce4-9ca9-4b05-9dd2-faa01552724e tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:54.244441 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f09e8ce4-9ca9-4b05-9dd2-faa01552724e tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:54.251066 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f09e8ce4-9ca9-4b05-9dd2-faa01552724e tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:54.251515 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f09e8ce4-9ca9-4b05-9dd2-faa01552724e tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:54.252274 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f09e8ce4-9ca9-4b05-9dd2-faa01552724e tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:54.252710 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f09e8ce4-9ca9-4b05-9dd2-faa01552724e tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:54.394146 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f09e8ce4-9ca9-4b05-9dd2-faa01552724e tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:54.402714 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f09e8ce4-9ca9-4b05-9dd2-faa01552724e tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1470 microversion: 2.1 time: 0.162852 Jul 18 17:04:54.403278 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 707/1413] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:54 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:55.378214 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-307baa2d-68b8-4954-b9d6-19a1c4745b2b req-8d475576-ad0b-4c9f-9321-fcbe17dadb64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1413acf9-9036-4fab-9039-1270de6b46d1", "name": "network-vif-deleted", "tag": "e9f4f356-d4cb-420c-a385-2e4f09a60957"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:04:55.389563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-307baa2d-68b8-4954-b9d6-19a1c4745b2b req-8d475576-ad0b-4c9f-9321-fcbe17dadb64 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:55.390015 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-307baa2d-68b8-4954-b9d6-19a1c4745b2b req-8d475576-ad0b-4c9f-9321-fcbe17dadb64 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:55.405659 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-307baa2d-68b8-4954-b9d6-19a1c4745b2b req-8d475576-ad0b-4c9f-9321-fcbe17dadb64 service nova] Creating event network-vif-deleted:e9f4f356-d4cb-420c-a385-2e4f09a60957 for instance 1413acf9-9036-4fab-9039-1270de6b46d1 on hv-cinder-83754 Jul 18 17:04:55.411026 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-307baa2d-68b8-4954-b9d6-19a1c4745b2b req-8d475576-ad0b-4c9f-9321-fcbe17dadb64 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036656 Jul 18 17:04:55.411845 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 707/1414] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:04:55.419989 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2e1db900-a29d-408c-8244-8841cb93f0c2 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:55.420530 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2e1db900-a29d-408c-8244-8841cb93f0c2 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:55.427415 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2e1db900-a29d-408c-8244-8841cb93f0c2 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:55.427865 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2e1db900-a29d-408c-8244-8841cb93f0c2 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:55.428635 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2e1db900-a29d-408c-8244-8841cb93f0c2 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:55.429100 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2e1db900-a29d-408c-8244-8841cb93f0c2 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:55.501497 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2e1db900-a29d-408c-8244-8841cb93f0c2 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab865b95180849e0aaf9eacb9eabc446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1954560e876d4b1fbfec255b13ca7ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:04:55.509775 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2e1db900-a29d-408c-8244-8841cb93f0c2 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 200 len: 1428 microversion: 2.1 time: 0.093904 Jul 18 17:04:55.510889 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 708/1415] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:55 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:04:56.528463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f62c2e4c-af17-4bd6-9880-160aea4be574 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:04:56.529188 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f62c2e4c-af17-4bd6-9880-160aea4be574 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] [instance: 1413acf9-9036-4fab-9039-1270de6b46d1] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:04:56.535467 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f62c2e4c-af17-4bd6-9880-160aea4be574 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:56.535914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f62c2e4c-af17-4bd6-9880-160aea4be574 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:56.536705 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f62c2e4c-af17-4bd6-9880-160aea4be574 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:04:56.537182 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f62c2e4c-af17-4bd6-9880-160aea4be574 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:04:56.552488 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-f62c2e4c-af17-4bd6-9880-160aea4be574 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] HTTP exception thrown: Instance 1413acf9-9036-4fab-9039-1270de6b46d1 could not be found. Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f62c2e4c-af17-4bd6-9880-160aea4be574 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Request method failure captured: Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 HTTP/1.1 Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1ZKUUtDGUutLDnZGe3yZtkgVdhpApM4qJQnXExf67CbZ2inCkcmBphMlLdoRXPu-v4zq8MNekh949-nM3sX0CE3lOk1WdsOwWaLcRb4J1GgZg3o2RpldLvEuP8G-zn-3hqE0KnNVRAWNQnbRPmaqLTxyQHapsIbk5z38M5lIQkDHqJU Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 1954560e876d4b1fbfec255b13ca7ba4 Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesNegativeTest-746353396 Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:04:56.554183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:04:56.555999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1954560e876d4b1fbfec255b13ca7ba4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1954560e876d4b1fbfec255b13ca7ba4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1954560e876d4b1fbfec255b13ca7ba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1954560e876d4b1fbfec255b13ca7ba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:04:56.555999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesNegativeTest-746353396 Jul 18 17:04:56.555999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 1954560e876d4b1fbfec255b13ca7ba4 Jul 18 17:04:56.555999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesNegativeTest-746353396 Jul 18 17:04:56.555999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesNegativeTest-746353396-project Jul 18 17:04:56.555999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:04:56.555999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:04:56.555999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: ab865b95180849e0aaf9eacb9eabc446 Jul 18 17:04:56.555999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesNegativeTest-746353396-project Jul 18 17:04:56.555999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:04:56.555999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 1413acf9-9036-4fab-9039-1270de6b46d1 could not be found. Jul 18 17:04:56.555999 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '1413acf9-9036-4fab-9039-1270de6b46d1'} Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1413acf9-9036-4fab-9039-1270de6b46d1 could not be found. Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:04:56.557104 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1413acf9-9036-4fab-9039-1270de6b46d1 could not be found. Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1413acf9-9036-4fab-9039-1270de6b46d1 could not be found. Jul 18 17:04:56.566595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:04:56.568598 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f62c2e4c-af17-4bd6-9880-160aea4be574 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] Returning 404 to user: Instance 1413acf9-9036-4fab-9039-1270de6b46d1 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:04:56.568598 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f62c2e4c-af17-4bd6-9880-160aea4be574 tempest-VolumesNegativeTest-746353396 tempest-VolumesNegativeTest-746353396-project] 10.222.0.76 "GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1" status: 404 len: 111 microversion: 2.1 time: 0.032679 Jul 18 17:04:56.568598 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 708/1416] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:04:56 2022] GET /compute/v2.1/servers/1413acf9-9036-4fab-9039-1270de6b46d1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:06:27.141613 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=29 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:27.142383 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=17 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:27.147023 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-698412067", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "networks": [{"uuid": "cf5e031f-57f6-453f-bee9-c7123baafef3"}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:06:27.357947 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] validate_networks() for [('cf5e031f-57f6-453f-bee9-c7123baafef3', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:06:27.754115 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:06:27.754540 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:06:27.755012 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:06:27.755422 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:06:27.755866 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:06:27.765025 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:27.765469 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:27.766264 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:27.766702 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:27.785182 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Getting quotas for project 80a3312c4364471fb98f892fc1461bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:06:27.788898 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Getting quotas for user 0fdca3c347134bd5a4c327c8b1230773 and project 80a3312c4364471fb98f892fc1461bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:06:27.800852 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:06:27.802984 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:06:27.929890 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2dc510d7-1217-49c4-a18e-4f037e161209 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789884 Jul 18 17:06:27.930553 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 709/1417] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 17:06:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 17:06:27.938889 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:27.939680 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=21 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:27.944463 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3dcbe4dd-5164-4be7-a927-7312ab337f25 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:06:27.945103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3dcbe4dd-5164-4be7-a927-7312ab337f25 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:06:28.061591 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3dcbe4dd-5164-4be7-a927-7312ab337f25 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:06:28.069283 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3dcbe4dd-5164-4be7-a927-7312ab337f25 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1218 microversion: 2.1 time: 0.132404 Jul 18 17:06:28.069851 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 709/1418] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:06:27 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:06:29.086484 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5dbf1a4e-17fd-4862-b628-aebd4971728f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:06:29.087082 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5dbf1a4e-17fd-4862-b628-aebd4971728f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:06:29.094051 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5dbf1a4e-17fd-4862-b628-aebd4971728f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:29.094505 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5dbf1a4e-17fd-4862-b628-aebd4971728f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:29.095277 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5dbf1a4e-17fd-4862-b628-aebd4971728f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:29.095753 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5dbf1a4e-17fd-4862-b628-aebd4971728f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:29.157935 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5dbf1a4e-17fd-4862-b628-aebd4971728f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:06:29.166584 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5dbf1a4e-17fd-4862-b628-aebd4971728f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1222 microversion: 2.1 time: 0.084125 Jul 18 17:06:29.167153 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 710/1419] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:06:29 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:06:30.184051 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3498e025-1ec6-4bde-9ee2-9e3e5c4ccefc tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:06:30.184703 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3498e025-1ec6-4bde-9ee2-9e3e5c4ccefc tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:06:30.195053 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3498e025-1ec6-4bde-9ee2-9e3e5c4ccefc tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:30.195790 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3498e025-1ec6-4bde-9ee2-9e3e5c4ccefc tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:30.197227 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3498e025-1ec6-4bde-9ee2-9e3e5c4ccefc tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:30.198029 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3498e025-1ec6-4bde-9ee2-9e3e5c4ccefc tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:30.267798 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3498e025-1ec6-4bde-9ee2-9e3e5c4ccefc tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:06:30.275704 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3498e025-1ec6-4bde-9ee2-9e3e5c4ccefc tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1222 microversion: 2.1 time: 0.095807 Jul 18 17:06:30.276262 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 710/1420] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:06:30 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:06:31.292970 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-942b8feb-d3b8-4003-b2dc-ca95a52395fd tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:06:31.293720 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-942b8feb-d3b8-4003-b2dc-ca95a52395fd tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:06:31.301267 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-942b8feb-d3b8-4003-b2dc-ca95a52395fd tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:31.302005 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-942b8feb-d3b8-4003-b2dc-ca95a52395fd tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:31.302785 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-942b8feb-d3b8-4003-b2dc-ca95a52395fd tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:31.303228 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-942b8feb-d3b8-4003-b2dc-ca95a52395fd tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:31.378981 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-942b8feb-d3b8-4003-b2dc-ca95a52395fd tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:06:31.386613 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-942b8feb-d3b8-4003-b2dc-ca95a52395fd tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1278 microversion: 2.1 time: 0.097593 Jul 18 17:06:31.387360 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 711/1421] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:06:31 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:06:32.405406 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1e4aa9fa-e5cf-40b9-a39e-2e5fab8b851c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:06:32.406031 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1e4aa9fa-e5cf-40b9-a39e-2e5fab8b851c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:06:32.414112 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1e4aa9fa-e5cf-40b9-a39e-2e5fab8b851c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:32.414484 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1e4aa9fa-e5cf-40b9-a39e-2e5fab8b851c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:32.415522 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1e4aa9fa-e5cf-40b9-a39e-2e5fab8b851c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:32.416142 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1e4aa9fa-e5cf-40b9-a39e-2e5fab8b851c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:32.631676 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1e4aa9fa-e5cf-40b9-a39e-2e5fab8b851c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:06:32.640195 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1e4aa9fa-e5cf-40b9-a39e-2e5fab8b851c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1318 microversion: 2.1 time: 0.240048 Jul 18 17:06:32.640780 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 711/1422] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:06:32 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:06:33.041414 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-9b4f33ca-9c9e-48df-a93e-187d4c391ad2 req-7ad78bcd-0f75-4d6a-a189-35cda0121c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9fd1f04-f74a-45a0-b21e-f657830de080", "tag": "12dfbff6-73b8-402d-b0c0-00b49b5324a6"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:06:33.050890 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-9b4f33ca-9c9e-48df-a93e-187d4c391ad2 req-7ad78bcd-0f75-4d6a-a189-35cda0121c14 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:33.051469 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-9b4f33ca-9c9e-48df-a93e-187d4c391ad2 req-7ad78bcd-0f75-4d6a-a189-35cda0121c14 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:33.063621 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-9b4f33ca-9c9e-48df-a93e-187d4c391ad2 req-7ad78bcd-0f75-4d6a-a189-35cda0121c14 service nova] Creating event network-changed:12dfbff6-73b8-402d-b0c0-00b49b5324a6 for instance b9fd1f04-f74a-45a0-b21e-f657830de080 on hv-cinder-83754 Jul 18 17:06:33.069468 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-9b4f33ca-9c9e-48df-a93e-187d4c391ad2 req-7ad78bcd-0f75-4d6a-a189-35cda0121c14 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032742 Jul 18 17:06:33.070092 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 712/1423] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:06:33.657941 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a913addb-acdb-4dcc-b663-aa57451ccc6d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:06:33.659265 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a913addb-acdb-4dcc-b663-aa57451ccc6d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:06:33.665925 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a913addb-acdb-4dcc-b663-aa57451ccc6d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:33.666376 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a913addb-acdb-4dcc-b663-aa57451ccc6d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:33.667143 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a913addb-acdb-4dcc-b663-aa57451ccc6d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:33.667588 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a913addb-acdb-4dcc-b663-aa57451ccc6d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:33.895041 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a913addb-acdb-4dcc-b663-aa57451ccc6d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:06:33.902759 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a913addb-acdb-4dcc-b663-aa57451ccc6d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1318 microversion: 2.1 time: 0.248695 Jul 18 17:06:33.903331 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 712/1424] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:06:33 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:06:34.920300 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ab4c7ab0-96b2-4ad6-8a43-7e42eca3707b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:06:34.920995 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ab4c7ab0-96b2-4ad6-8a43-7e42eca3707b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:06:34.928478 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ab4c7ab0-96b2-4ad6-8a43-7e42eca3707b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:34.928932 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ab4c7ab0-96b2-4ad6-8a43-7e42eca3707b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:34.929737 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ab4c7ab0-96b2-4ad6-8a43-7e42eca3707b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:34.930181 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ab4c7ab0-96b2-4ad6-8a43-7e42eca3707b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:35.063475 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ab4c7ab0-96b2-4ad6-8a43-7e42eca3707b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:06:35.070923 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ab4c7ab0-96b2-4ad6-8a43-7e42eca3707b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1318 microversion: 2.1 time: 0.154877 Jul 18 17:06:35.071496 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 713/1425] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:06:34 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:06:36.088183 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7b97fdd3-5b45-4bdf-b701-ff6f3b495470 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:06:36.088820 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7b97fdd3-5b45-4bdf-b701-ff6f3b495470 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:06:36.095443 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7b97fdd3-5b45-4bdf-b701-ff6f3b495470 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:36.095906 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7b97fdd3-5b45-4bdf-b701-ff6f3b495470 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:36.096792 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7b97fdd3-5b45-4bdf-b701-ff6f3b495470 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:36.097295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7b97fdd3-5b45-4bdf-b701-ff6f3b495470 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:36.230679 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7b97fdd3-5b45-4bdf-b701-ff6f3b495470 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:06:36.239111 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7b97fdd3-5b45-4bdf-b701-ff6f3b495470 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1318 microversion: 2.1 time: 0.154917 Jul 18 17:06:36.239685 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 713/1426] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:06:36 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:06:37.256398 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5a58020e-035b-43bc-b0c8-616f0fc8ed3d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:06:37.257030 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5a58020e-035b-43bc-b0c8-616f0fc8ed3d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:06:37.263537 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a58020e-035b-43bc-b0c8-616f0fc8ed3d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:37.263990 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a58020e-035b-43bc-b0c8-616f0fc8ed3d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:37.264752 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a58020e-035b-43bc-b0c8-616f0fc8ed3d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:37.265227 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a58020e-035b-43bc-b0c8-616f0fc8ed3d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:37.395805 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5a58020e-035b-43bc-b0c8-616f0fc8ed3d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:06:37.403197 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5a58020e-035b-43bc-b0c8-616f0fc8ed3d tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1318 microversion: 2.1 time: 0.151393 Jul 18 17:06:37.403778 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 714/1427] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:06:37 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:06:37.682541 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:06:37.683139 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Mon Jul 18 17:06:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:06:38.420563 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-46de2bff-4ced-45c4-89ce-b8b6b9e52a64 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:06:38.421291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-46de2bff-4ced-45c4-89ce-b8b6b9e52a64 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:06:38.423733 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:38.429034 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46de2bff-4ced-45c4-89ce-b8b6b9e52a64 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:38.431810 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46de2bff-4ced-45c4-89ce-b8b6b9e52a64 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:38.431810 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46de2bff-4ced-45c4-89ce-b8b6b9e52a64 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:38.431810 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46de2bff-4ced-45c4-89ce-b8b6b9e52a64 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:38.565000 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-46de2bff-4ced-45c4-89ce-b8b6b9e52a64 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:06:38.573373 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-46de2bff-4ced-45c4-89ce-b8b6b9e52a64 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1318 microversion: 2.1 time: 0.157416 Jul 18 17:06:38.573943 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 714/1428] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:06:38 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:06:39.591653 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4f04423d-fab6-4ee3-9bfb-e347235172ba tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:06:39.592267 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4f04423d-fab6-4ee3-9bfb-e347235172ba tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:06:39.594216 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:39.594882 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:39.600886 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f04423d-fab6-4ee3-9bfb-e347235172ba tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:39.608355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f04423d-fab6-4ee3-9bfb-e347235172ba tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:39.608355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f04423d-fab6-4ee3-9bfb-e347235172ba tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:39.608355 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f04423d-fab6-4ee3-9bfb-e347235172ba tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:39.738057 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4f04423d-fab6-4ee3-9bfb-e347235172ba tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:06:39.745727 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4f04423d-fab6-4ee3-9bfb-e347235172ba tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1318 microversion: 2.1 time: 0.157953 Jul 18 17:06:39.746446 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 715/1429] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:06:39 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:06:40.000643 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-18b763c2-0225-4cc4-9253-837058143b04 req-4554cdca-4988-4cf2-a059-a1f719b607d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd1f04-f74a-45a0-b21e-f657830de080", "name": "network-vif-plugged", "status": "completed", "tag": "12dfbff6-73b8-402d-b0c0-00b49b5324a6"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:06:40.010816 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-18b763c2-0225-4cc4-9253-837058143b04 req-4554cdca-4988-4cf2-a059-a1f719b607d6 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:40.011423 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-18b763c2-0225-4cc4-9253-837058143b04 req-4554cdca-4988-4cf2-a059-a1f719b607d6 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:40.025585 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-18b763c2-0225-4cc4-9253-837058143b04 req-4554cdca-4988-4cf2-a059-a1f719b607d6 service nova] Creating event network-vif-plugged:12dfbff6-73b8-402d-b0c0-00b49b5324a6 for instance b9fd1f04-f74a-45a0-b21e-f657830de080 on hv-cinder-83754 Jul 18 17:06:40.030585 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-18b763c2-0225-4cc4-9253-837058143b04 req-4554cdca-4988-4cf2-a059-a1f719b607d6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033715 Jul 18 17:06:40.031193 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 715/1430] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:06:40.763313 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-68cdb960-9bfa-4d72-b34c-be9e1bb7a095 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:06:40.763970 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-68cdb960-9bfa-4d72-b34c-be9e1bb7a095 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:06:40.771259 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-68cdb960-9bfa-4d72-b34c-be9e1bb7a095 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:40.771705 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-68cdb960-9bfa-4d72-b34c-be9e1bb7a095 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:40.772468 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-68cdb960-9bfa-4d72-b34c-be9e1bb7a095 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:40.772903 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-68cdb960-9bfa-4d72-b34c-be9e1bb7a095 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:40.905970 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-68cdb960-9bfa-4d72-b34c-be9e1bb7a095 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:06:40.914360 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-68cdb960-9bfa-4d72-b34c-be9e1bb7a095 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1318 microversion: 2.1 time: 0.154936 Jul 18 17:06:40.914932 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 716/1431] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:06:40 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:06:41.932885 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4eeaab50-8273-40f4-a9af-bef52ab139e9 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:06:41.933557 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4eeaab50-8273-40f4-a9af-bef52ab139e9 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:06:41.940030 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4eeaab50-8273-40f4-a9af-bef52ab139e9 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:41.940485 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4eeaab50-8273-40f4-a9af-bef52ab139e9 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:41.941286 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4eeaab50-8273-40f4-a9af-bef52ab139e9 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:06:41.941728 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4eeaab50-8273-40f4-a9af-bef52ab139e9 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:06:42.074526 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4eeaab50-8273-40f4-a9af-bef52ab139e9 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:06:42.082778 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4eeaab50-8273-40f4-a9af-bef52ab139e9 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1508 microversion: 2.1 time: 0.154674 Jul 18 17:06:42.083377 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 716/1432] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:06:41 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:07:03.779979 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4871b7e3-cb09-4356-bcc2-badfc951ddd7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f13c3d9-df3f-4aa1-ad63-7ca816c3ae71", "device": "/dev/sdb"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:07:03.781491 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4871b7e3-cb09-4356-bcc2-badfc951ddd7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:03.783649 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:07:03.784402 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=40 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:07:03.789441 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4871b7e3-cb09-4356-bcc2-badfc951ddd7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:03.789894 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4871b7e3-cb09-4356-bcc2-badfc951ddd7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:03.790802 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4871b7e3-cb09-4356-bcc2-badfc951ddd7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:03.791154 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4871b7e3-cb09-4356-bcc2-badfc951ddd7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:04.610508 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4871b7e3-cb09-4356-bcc2-badfc951ddd7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "POST /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834444 Jul 18 17:07:04.611200 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 717/1433] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 17:07:03 2022] POST /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:07:30.276158 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:07:30.276750 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Mon Jul 18 17:07:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:07:32.448600 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-af9d9389-2bb4-4f17-9f71-1a85b8bf9b26 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:32.449337 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-af9d9389-2bb4-4f17-9f71-1a85b8bf9b26 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:32.451206 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=18 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:07:32.451909 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=38 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:07:32.457610 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af9d9389-2bb4-4f17-9f71-1a85b8bf9b26 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:32.458456 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af9d9389-2bb4-4f17-9f71-1a85b8bf9b26 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:32.459751 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af9d9389-2bb4-4f17-9f71-1a85b8bf9b26 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:32.460193 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af9d9389-2bb4-4f17-9f71-1a85b8bf9b26 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:32.558632 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-af9d9389-2bb4-4f17-9f71-1a85b8bf9b26 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lazy-loading 'services' on Instance uuid b9fd1f04-f74a-45a0-b21e-f657830de080 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:07:32.812081 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-af9d9389-2bb4-4f17-9f71-1a85b8bf9b26 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080/os-volume_attachments/6f13c3d9-df3f-4aa1-ad63-7ca816c3ae71" status: 202 len: 0 microversion: 2.1 time: 0.368978 Jul 18 17:07:32.812678 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 717/1434] 10.222.0.76 () {58 vars in 1415 bytes} [Mon Jul 18 17:07:32 2022] DELETE /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080/os-volume_attachments/6f13c3d9-df3f-4aa1-ad63-7ca816c3ae71 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:07:35.010383 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:07:35.011234 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:07:35.015449 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cf343f82-d27e-4075-9521-82230454fb7e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:35.016113 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cf343f82-d27e-4075-9521-82230454fb7e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:35.022732 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cf343f82-d27e-4075-9521-82230454fb7e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:35.024904 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cf343f82-d27e-4075-9521-82230454fb7e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:35.024904 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cf343f82-d27e-4075-9521-82230454fb7e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:35.024904 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cf343f82-d27e-4075-9521-82230454fb7e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:35.055152 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cf343f82-d27e-4075-9521-82230454fb7e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:07:35.393709 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cf343f82-d27e-4075-9521-82230454fb7e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 204 len: 0 microversion: 2.1 time: 0.385026 Jul 18 17:07:35.394302 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 718/1435] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:07:35 2022] DELETE /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:07:35.404264 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-efcc4b9f-4d53-42f0-ad8c-32b4b0478c1e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:35.405430 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-efcc4b9f-4d53-42f0-ad8c-32b4b0478c1e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:35.411490 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-efcc4b9f-4d53-42f0-ad8c-32b4b0478c1e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:35.411944 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-efcc4b9f-4d53-42f0-ad8c-32b4b0478c1e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:35.412712 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-efcc4b9f-4d53-42f0-ad8c-32b4b0478c1e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:35.413876 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-efcc4b9f-4d53-42f0-ad8c-32b4b0478c1e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:35.550641 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-efcc4b9f-4d53-42f0-ad8c-32b4b0478c1e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:07:35.558304 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-efcc4b9f-4d53-42f0-ad8c-32b4b0478c1e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1514 microversion: 2.1 time: 0.158971 Jul 18 17:07:35.558860 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 718/1436] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:07:35 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:07:36.576258 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7e143920-97ae-41d8-b3d3-2fc1e162d75a tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:36.576960 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7e143920-97ae-41d8-b3d3-2fc1e162d75a tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:36.583507 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e143920-97ae-41d8-b3d3-2fc1e162d75a tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:36.583962 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e143920-97ae-41d8-b3d3-2fc1e162d75a tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:36.584732 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e143920-97ae-41d8-b3d3-2fc1e162d75a tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:36.585203 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e143920-97ae-41d8-b3d3-2fc1e162d75a tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:36.715708 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7e143920-97ae-41d8-b3d3-2fc1e162d75a tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:07:36.723299 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7e143920-97ae-41d8-b3d3-2fc1e162d75a tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1514 microversion: 2.1 time: 0.151316 Jul 18 17:07:36.723869 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 719/1437] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:07:36 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:07:37.743130 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4f461284-2d89-44db-8bb7-c5101ea81ce2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:37.743777 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4f461284-2d89-44db-8bb7-c5101ea81ce2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:37.750353 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4f461284-2d89-44db-8bb7-c5101ea81ce2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:37.750803 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4f461284-2d89-44db-8bb7-c5101ea81ce2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:37.751631 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4f461284-2d89-44db-8bb7-c5101ea81ce2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:37.752070 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4f461284-2d89-44db-8bb7-c5101ea81ce2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:37.849874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4f461284-2d89-44db-8bb7-c5101ea81ce2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:07:37.859269 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4f461284-2d89-44db-8bb7-c5101ea81ce2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1472 microversion: 2.1 time: 0.120042 Jul 18 17:07:37.859989 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 719/1438] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:07:37 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1472 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:07:37.902325 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-adf79b3f-95e3-4711-b834-d0a82550fc32 req-56a2b4f2-3ad9-4d21-97f9-e540e2527900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd1f04-f74a-45a0-b21e-f657830de080", "name": "network-vif-deleted", "tag": "12dfbff6-73b8-402d-b0c0-00b49b5324a6"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:07:37.910903 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-adf79b3f-95e3-4711-b834-d0a82550fc32 req-56a2b4f2-3ad9-4d21-97f9-e540e2527900 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:37.911755 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-adf79b3f-95e3-4711-b834-d0a82550fc32 req-56a2b4f2-3ad9-4d21-97f9-e540e2527900 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:37.922769 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-adf79b3f-95e3-4711-b834-d0a82550fc32 req-56a2b4f2-3ad9-4d21-97f9-e540e2527900 service nova] Creating event network-vif-deleted:12dfbff6-73b8-402d-b0c0-00b49b5324a6 for instance b9fd1f04-f74a-45a0-b21e-f657830de080 on hv-cinder-83754 Jul 18 17:07:37.927540 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-adf79b3f-95e3-4711-b834-d0a82550fc32 req-56a2b4f2-3ad9-4d21-97f9-e540e2527900 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029066 Jul 18 17:07:37.932020 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 720/1439] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:07:38.876908 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5dee4fdc-ced6-4511-bc33-d6ac819c3124 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:38.877513 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5dee4fdc-ced6-4511-bc33-d6ac819c3124 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:38.883920 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5dee4fdc-ced6-4511-bc33-d6ac819c3124 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:38.886848 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5dee4fdc-ced6-4511-bc33-d6ac819c3124 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:38.886848 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5dee4fdc-ced6-4511-bc33-d6ac819c3124 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:38.886848 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5dee4fdc-ced6-4511-bc33-d6ac819c3124 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:38.917041 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5dee4fdc-ced6-4511-bc33-d6ac819c3124 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:38.917486 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5dee4fdc-ced6-4511-bc33-d6ac819c3124 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:38.918811 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-5dee4fdc-ced6-4511-bc33-d6ac819c3124 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lazy-loading 'fault' on Instance uuid b9fd1f04-f74a-45a0-b21e-f657830de080 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:07:38.959295 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5dee4fdc-ced6-4511-bc33-d6ac819c3124 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:07:38.966362 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5dee4fdc-ced6-4511-bc33-d6ac819c3124 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 200 len: 1308 microversion: 2.1 time: 0.093501 Jul 18 17:07:38.966938 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 720/1440] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:07:38 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:07:39.985193 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7ce4bfb5-538d-4cdf-a21f-e869471ff1d0 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:39.985915 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7ce4bfb5-538d-4cdf-a21f-e869471ff1d0 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: b9fd1f04-f74a-45a0-b21e-f657830de080] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:39.992080 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7ce4bfb5-538d-4cdf-a21f-e869471ff1d0 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:39.992524 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7ce4bfb5-538d-4cdf-a21f-e869471ff1d0 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:39.994224 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7ce4bfb5-538d-4cdf-a21f-e869471ff1d0 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:39.994658 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7ce4bfb5-538d-4cdf-a21f-e869471ff1d0 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:40.007720 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-7ce4bfb5-538d-4cdf-a21f-e869471ff1d0 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] HTTP exception thrown: Instance b9fd1f04-f74a-45a0-b21e-f657830de080 could not be found. Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7ce4bfb5-538d-4cdf-a21f-e869471ff1d0 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Request method failure captured: Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 HTTP/1.1 Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Connection: close Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Host: 10.222.0.76 Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi1ZMR-tJ7kYN7sEEF64RQPLXbPPsf5wuLINcq0dGDH--B4nye92eFkHOYF9T4mHTUdSscRXv-sFrEy7AdLmbov42MHEDsEcDW0dQ5_mKm4NSyrW3IgAS2eik-nez9AqhMwysIvTGO9HUymQftwkbNkvOyrGsMXZgnSnkgouvgkuEHBF4 Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Id: 80a3312c4364471fb98f892fc1461bb7 Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1429965813 Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 18 17:07:40.009975 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 18 17:07:40.011830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_80a3312c4364471fb98f892fc1461bb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/80a3312c4364471fb98f892fc1461bb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/80a3312c4364471fb98f892fc1461bb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/80a3312c4364471fb98f892fc1461bb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:07:40.011830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-VolumesSnapshotTestJSON-1429965813 Jul 18 17:07:40.011830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 80a3312c4364471fb98f892fc1461bb7 Jul 18 17:07:40.011830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1429965813 Jul 18 17:07:40.011830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User: tempest-VolumesSnapshotTestJSON-1429965813-project Jul 18 17:07:40.011830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 18 17:07:40.011830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 18 17:07:40.011830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Id: 0fdca3c347134bd5a4c327c8b1230773 Jul 18 17:07:40.011830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-VolumesSnapshotTestJSON-1429965813-project Jul 18 17:07:40.011830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: method: > Jul 18 17:07:40.011830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: exception: Instance b9fd1f04-f74a-45a0-b21e-f657830de080 could not be found. Jul 18 17:07:40.011830 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: action_args: {'id': 'b9fd1f04-f74a-45a0-b21e-f657830de080'} Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9fd1f04-f74a-45a0-b21e-f657830de080 could not be found. Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:07:40.013155 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9fd1f04-f74a-45a0-b21e-f657830de080 could not be found. Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9fd1f04-f74a-45a0-b21e-f657830de080 could not be found. Jul 18 17:07:40.015088 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 18 17:07:40.016654 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7ce4bfb5-538d-4cdf-a21f-e869471ff1d0 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Returning 404 to user: Instance b9fd1f04-f74a-45a0-b21e-f657830de080 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:07:40.016654 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7ce4bfb5-538d-4cdf-a21f-e869471ff1d0 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080" status: 404 len: 111 microversion: 2.1 time: 0.031155 Jul 18 17:07:40.016654 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 721/1441] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:07:39 2022] GET /compute/v2.1/servers/b9fd1f04-f74a-45a0-b21e-f657830de080 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:07:50.613905 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-586270711", "imageRef": "b0ca13c3-7745-458f-8b76-99238dd5c07f", "flavorRef": "452", "networks": [{"uuid": "cf5e031f-57f6-453f-bee9-c7123baafef3"}]}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:07:50.620794 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=10 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:07:50.621482 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:07:50.667220 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] validate_networks() for [('cf5e031f-57f6-453f-bee9-c7123baafef3', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:07:51.110018 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:07:51.110444 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:07:51.110955 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:07:51.111371 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:07:51.111786 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:07:51.121089 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:51.121541 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:51.122346 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:51.122782 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:51.140615 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Getting quotas for project 80a3312c4364471fb98f892fc1461bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:07:51.144873 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Getting quotas for user 0fdca3c347134bd5a4c327c8b1230773 and project 80a3312c4364471fb98f892fc1461bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:07:51.156520 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:07:51.158844 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0ca13c3-7745-458f-8b76-99238dd5c07f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:07:51.265776 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-335ade62-75af-47e5-8687-454257e1278e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655643 Jul 18 17:07:51.266595 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 721/1442] 10.222.0.76 () {60 vars in 1146 bytes} [Mon Jul 18 17:07:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 17:07:51.277076 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a192fec0-bbb5-4e2e-83bf-a1f28f6f50cc tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:51.277843 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a192fec0-bbb5-4e2e-83bf-a1f28f6f50cc tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:51.279992 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:07:51.280658 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:07:51.337233 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a192fec0-bbb5-4e2e-83bf-a1f28f6f50cc tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:07:51.344051 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a192fec0-bbb5-4e2e-83bf-a1f28f6f50cc tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1218 microversion: 2.1 time: 0.071454 Jul 18 17:07:51.344732 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 722/1443] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:07:51 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:07:52.361901 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4fbd18e1-8f18-45ff-8e74-9ead78f808ee tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:52.362552 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4fbd18e1-8f18-45ff-8e74-9ead78f808ee tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:52.369163 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4fbd18e1-8f18-45ff-8e74-9ead78f808ee tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:52.369614 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4fbd18e1-8f18-45ff-8e74-9ead78f808ee tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:52.371316 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4fbd18e1-8f18-45ff-8e74-9ead78f808ee tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:52.371512 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4fbd18e1-8f18-45ff-8e74-9ead78f808ee tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:52.433914 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4fbd18e1-8f18-45ff-8e74-9ead78f808ee tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:07:52.441317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4fbd18e1-8f18-45ff-8e74-9ead78f808ee tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1214 microversion: 2.1 time: 0.083327 Jul 18 17:07:52.441871 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 722/1444] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:07:52 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:07:53.460959 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d6124728-ad81-4ba0-8d03-3747313da3f7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:53.461597 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d6124728-ad81-4ba0-8d03-3747313da3f7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:53.470265 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6124728-ad81-4ba0-8d03-3747313da3f7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:53.470764 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6124728-ad81-4ba0-8d03-3747313da3f7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:53.471527 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6124728-ad81-4ba0-8d03-3747313da3f7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:53.471962 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6124728-ad81-4ba0-8d03-3747313da3f7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:53.536372 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d6124728-ad81-4ba0-8d03-3747313da3f7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:07:53.544432 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d6124728-ad81-4ba0-8d03-3747313da3f7 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1276 microversion: 2.1 time: 0.089606 Jul 18 17:07:53.545084 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 723/1445] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:07:53 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:07:54.562017 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-aa1cb749-ba68-43cd-82f9-8535f3eac007 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:54.562636 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-aa1cb749-ba68-43cd-82f9-8535f3eac007 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:54.569881 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aa1cb749-ba68-43cd-82f9-8535f3eac007 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:54.570338 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aa1cb749-ba68-43cd-82f9-8535f3eac007 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:54.571132 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aa1cb749-ba68-43cd-82f9-8535f3eac007 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:54.571572 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aa1cb749-ba68-43cd-82f9-8535f3eac007 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:54.775509 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-aa1cb749-ba68-43cd-82f9-8535f3eac007 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:07:54.784226 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-aa1cb749-ba68-43cd-82f9-8535f3eac007 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1318 microversion: 2.1 time: 0.226170 Jul 18 17:07:54.784835 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 723/1446] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:07:54 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:07:55.132224 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-74884f82-e26c-40f8-b645-f0525fb0b0ad req-6cc7fb9f-7d47-4563-8257-c3fe68f6a7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b1b4c8d-01b6-45cc-971e-85e0a98471d2", "tag": "01cfe727-9f26-410a-9575-3892544441c3"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:07:55.143048 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-74884f82-e26c-40f8-b645-f0525fb0b0ad req-6cc7fb9f-7d47-4563-8257-c3fe68f6a7a3 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:55.143517 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-74884f82-e26c-40f8-b645-f0525fb0b0ad req-6cc7fb9f-7d47-4563-8257-c3fe68f6a7a3 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:55.155212 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-74884f82-e26c-40f8-b645-f0525fb0b0ad req-6cc7fb9f-7d47-4563-8257-c3fe68f6a7a3 service nova] Creating event network-changed:01cfe727-9f26-410a-9575-3892544441c3 for instance 9b1b4c8d-01b6-45cc-971e-85e0a98471d2 on hv-cinder-83754 Jul 18 17:07:55.160494 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-74884f82-e26c-40f8-b645-f0525fb0b0ad req-6cc7fb9f-7d47-4563-8257-c3fe68f6a7a3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032082 Jul 18 17:07:55.161121 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 724/1447] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:07:55.800960 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0a46373a-6a4c-4e51-9067-59efcd03dbae tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:55.801593 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0a46373a-6a4c-4e51-9067-59efcd03dbae tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:55.809170 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0a46373a-6a4c-4e51-9067-59efcd03dbae tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:55.809629 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0a46373a-6a4c-4e51-9067-59efcd03dbae tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:55.810399 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0a46373a-6a4c-4e51-9067-59efcd03dbae tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:55.810832 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0a46373a-6a4c-4e51-9067-59efcd03dbae tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:55.967111 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0a46373a-6a4c-4e51-9067-59efcd03dbae tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:07:55.974805 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0a46373a-6a4c-4e51-9067-59efcd03dbae tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1318 microversion: 2.1 time: 0.177613 Jul 18 17:07:55.975371 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 724/1448] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:07:55 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:07:56.995570 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8027ea99-95d5-4961-841e-6fbfd19eb514 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:56.996281 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8027ea99-95d5-4961-841e-6fbfd19eb514 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:57.002693 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8027ea99-95d5-4961-841e-6fbfd19eb514 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:57.003148 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8027ea99-95d5-4961-841e-6fbfd19eb514 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:57.003914 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8027ea99-95d5-4961-841e-6fbfd19eb514 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:57.004352 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8027ea99-95d5-4961-841e-6fbfd19eb514 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:57.138185 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8027ea99-95d5-4961-841e-6fbfd19eb514 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:07:57.145811 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8027ea99-95d5-4961-841e-6fbfd19eb514 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1318 microversion: 2.1 time: 0.155282 Jul 18 17:07:57.146675 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 725/1449] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:07:56 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:07:58.165466 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-44f7d807-35fd-4e02-9613-df6d2cdf23d8 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:58.166026 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-44f7d807-35fd-4e02-9613-df6d2cdf23d8 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:58.173499 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-44f7d807-35fd-4e02-9613-df6d2cdf23d8 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:58.174011 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-44f7d807-35fd-4e02-9613-df6d2cdf23d8 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:58.174816 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-44f7d807-35fd-4e02-9613-df6d2cdf23d8 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:58.175159 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-44f7d807-35fd-4e02-9613-df6d2cdf23d8 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:58.309874 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-44f7d807-35fd-4e02-9613-df6d2cdf23d8 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:07:58.317503 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-44f7d807-35fd-4e02-9613-df6d2cdf23d8 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1318 microversion: 2.1 time: 0.157292 Jul 18 17:07:58.318088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 725/1450] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:07:58 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:07:59.334518 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-98990f7d-d6fa-453c-9d2e-7c4c3dddb926 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:07:59.335131 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-98990f7d-d6fa-453c-9d2e-7c4c3dddb926 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:07:59.342006 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98990f7d-d6fa-453c-9d2e-7c4c3dddb926 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:59.342462 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98990f7d-d6fa-453c-9d2e-7c4c3dddb926 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:59.343237 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98990f7d-d6fa-453c-9d2e-7c4c3dddb926 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:07:59.343681 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98990f7d-d6fa-453c-9d2e-7c4c3dddb926 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:07:59.478584 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-98990f7d-d6fa-453c-9d2e-7c4c3dddb926 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:07:59.486338 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-98990f7d-d6fa-453c-9d2e-7c4c3dddb926 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1318 microversion: 2.1 time: 0.155736 Jul 18 17:07:59.486905 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 726/1451] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:07:59 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:00.504147 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-73eab5df-6ba4-449a-829c-1be9b7837a15 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:00.504842 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-73eab5df-6ba4-449a-829c-1be9b7837a15 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:00.511364 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-73eab5df-6ba4-449a-829c-1be9b7837a15 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:00.511833 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-73eab5df-6ba4-449a-829c-1be9b7837a15 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:00.512613 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-73eab5df-6ba4-449a-829c-1be9b7837a15 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:00.513100 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-73eab5df-6ba4-449a-829c-1be9b7837a15 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:00.649925 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-73eab5df-6ba4-449a-829c-1be9b7837a15 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:00.657529 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-73eab5df-6ba4-449a-829c-1be9b7837a15 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1318 microversion: 2.1 time: 0.157385 Jul 18 17:08:00.658088 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 726/1452] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:00 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:01.674573 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9ac9bbab-822f-478c-a710-90422e8f858e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:01.675172 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9ac9bbab-822f-478c-a710-90422e8f858e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:01.677608 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:08:01.682444 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ac9bbab-822f-478c-a710-90422e8f858e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:01.682888 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ac9bbab-822f-478c-a710-90422e8f858e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:01.683724 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ac9bbab-822f-478c-a710-90422e8f858e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:01.684777 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9ac9bbab-822f-478c-a710-90422e8f858e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:01.823127 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9ac9bbab-822f-478c-a710-90422e8f858e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:01.831661 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9ac9bbab-822f-478c-a710-90422e8f858e tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1318 microversion: 2.1 time: 0.160928 Jul 18 17:08:01.832226 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 727/1453] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:01 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:02.573801 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-e5ebce6d-0f0f-496d-b37e-b498baa583fe req-5a3a93e9-e1d3-48e3-82c2-bd96c1ee998c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b1b4c8d-01b6-45cc-971e-85e0a98471d2", "name": "network-vif-plugged", "status": "completed", "tag": "01cfe727-9f26-410a-9575-3892544441c3"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:08:02.578458 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:08:02.580379 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=6 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:08:02.585655 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e5ebce6d-0f0f-496d-b37e-b498baa583fe req-5a3a93e9-e1d3-48e3-82c2-bd96c1ee998c service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:02.586103 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e5ebce6d-0f0f-496d-b37e-b498baa583fe req-5a3a93e9-e1d3-48e3-82c2-bd96c1ee998c service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:02.597133 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-e5ebce6d-0f0f-496d-b37e-b498baa583fe req-5a3a93e9-e1d3-48e3-82c2-bd96c1ee998c service nova] Creating event network-vif-plugged:01cfe727-9f26-410a-9575-3892544441c3 for instance 9b1b4c8d-01b6-45cc-971e-85e0a98471d2 on hv-cinder-83754 Jul 18 17:08:02.602117 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-e5ebce6d-0f0f-496d-b37e-b498baa583fe req-5a3a93e9-e1d3-48e3-82c2-bd96c1ee998c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032015 Jul 18 17:08:02.606767 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 727/1454] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:08:02.848611 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-75457783-6553-48ee-99e4-e82f54cef40b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:02.849246 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-75457783-6553-48ee-99e4-e82f54cef40b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:02.855995 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-75457783-6553-48ee-99e4-e82f54cef40b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:02.857197 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-75457783-6553-48ee-99e4-e82f54cef40b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:02.858074 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-75457783-6553-48ee-99e4-e82f54cef40b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:02.858518 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-75457783-6553-48ee-99e4-e82f54cef40b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:02.991613 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-75457783-6553-48ee-99e4-e82f54cef40b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:02.999906 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-75457783-6553-48ee-99e4-e82f54cef40b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1318 microversion: 2.1 time: 0.155221 Jul 18 17:08:03.000476 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 728/1455] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:02 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:04.019510 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-66f90533-b6f3-4c28-922f-4bd357beadf2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:04.020201 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-66f90533-b6f3-4c28-922f-4bd357beadf2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:04.032030 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-66f90533-b6f3-4c28-922f-4bd357beadf2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:04.032030 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-66f90533-b6f3-4c28-922f-4bd357beadf2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:04.032030 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-66f90533-b6f3-4c28-922f-4bd357beadf2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:04.032030 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-66f90533-b6f3-4c28-922f-4bd357beadf2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:04.162284 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-66f90533-b6f3-4c28-922f-4bd357beadf2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:04.170476 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-66f90533-b6f3-4c28-922f-4bd357beadf2 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1318 microversion: 2.1 time: 0.156750 Jul 18 17:08:04.171110 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 728/1456] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:04 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:05.187534 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-60449771-fa0e-41e8-a02e-54cf16bca99f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:05.188145 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-60449771-fa0e-41e8-a02e-54cf16bca99f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:05.194745 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-60449771-fa0e-41e8-a02e-54cf16bca99f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:05.195193 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-60449771-fa0e-41e8-a02e-54cf16bca99f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:05.195955 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-60449771-fa0e-41e8-a02e-54cf16bca99f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:05.196391 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-60449771-fa0e-41e8-a02e-54cf16bca99f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:05.331130 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-60449771-fa0e-41e8-a02e-54cf16bca99f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:05.338783 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-60449771-fa0e-41e8-a02e-54cf16bca99f tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1507 microversion: 2.1 time: 0.155280 Jul 18 17:08:05.339409 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 729/1457] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:05 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:05.355326 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-da9d1d7b-461f-411e-b266-077ab7de480c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8e8538c-1206-49d3-9307-137a9188d3e4", "device": "/dev/sdb"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:08:05.357046 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-da9d1d7b-461f-411e-b266-077ab7de480c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:05.363849 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-da9d1d7b-461f-411e-b266-077ab7de480c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:05.364308 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-da9d1d7b-461f-411e-b266-077ab7de480c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:05.365109 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-da9d1d7b-461f-411e-b266-077ab7de480c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:05.365552 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-da9d1d7b-461f-411e-b266-077ab7de480c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:06.270302 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-da9d1d7b-461f-411e-b266-077ab7de480c tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "POST /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.918941 Jul 18 17:08:06.270958 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 729/1458] 10.222.0.76 () {60 vars in 1322 bytes} [Mon Jul 18 17:08:05 2022] POST /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2/os-volume_attachments => generated 194 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:08:30.407149 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-301e4fac-00b5-4d91-b6a6-1a4784dcb637 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:30.407662 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-301e4fac-00b5-4d91-b6a6-1a4784dcb637 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:30.409842 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=18 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:08:30.410497 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=38 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:08:30.415459 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-301e4fac-00b5-4d91-b6a6-1a4784dcb637 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:30.415909 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-301e4fac-00b5-4d91-b6a6-1a4784dcb637 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:30.416673 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-301e4fac-00b5-4d91-b6a6-1a4784dcb637 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:30.417150 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-301e4fac-00b5-4d91-b6a6-1a4784dcb637 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:30.500921 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-301e4fac-00b5-4d91-b6a6-1a4784dcb637 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lazy-loading 'services' on Instance uuid 9b1b4c8d-01b6-45cc-971e-85e0a98471d2 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:08:30.711271 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-301e4fac-00b5-4d91-b6a6-1a4784dcb637 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2/os-volume_attachments/f8e8538c-1206-49d3-9307-137a9188d3e4" status: 202 len: 0 microversion: 2.1 time: 0.307934 Jul 18 17:08:30.711790 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 730/1459] 10.222.0.76 () {58 vars in 1415 bytes} [Mon Jul 18 17:08:30 2022] DELETE /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2/os-volume_attachments/f8e8538c-1206-49d3-9307-137a9188d3e4 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:08:32.880015 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:08:32.880813 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:08:32.884801 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-04a34067-052c-44dc-ab7a-6c7559447e88 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:32.885426 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-04a34067-052c-44dc-ab7a-6c7559447e88 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:32.892515 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-04a34067-052c-44dc-ab7a-6c7559447e88 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:32.894003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-04a34067-052c-44dc-ab7a-6c7559447e88 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:32.894003 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-04a34067-052c-44dc-ab7a-6c7559447e88 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:32.894252 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-04a34067-052c-44dc-ab7a-6c7559447e88 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:32.920392 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-04a34067-052c-44dc-ab7a-6c7559447e88 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:08:33.180946 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-04a34067-052c-44dc-ab7a-6c7559447e88 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 204 len: 0 microversion: 2.1 time: 0.302015 Jul 18 17:08:33.181574 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 730/1460] 10.222.0.76 () {58 vars in 1238 bytes} [Mon Jul 18 17:08:32 2022] DELETE /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:08:33.191734 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-622c3e4f-d99d-4101-96e3-35a6594838e6 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:33.192458 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-622c3e4f-d99d-4101-96e3-35a6594838e6 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:33.199287 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-622c3e4f-d99d-4101-96e3-35a6594838e6 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:33.199731 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-622c3e4f-d99d-4101-96e3-35a6594838e6 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:33.200489 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-622c3e4f-d99d-4101-96e3-35a6594838e6 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:33.200957 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-622c3e4f-d99d-4101-96e3-35a6594838e6 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:33.331565 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-622c3e4f-d99d-4101-96e3-35a6594838e6 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:33.339244 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-622c3e4f-d99d-4101-96e3-35a6594838e6 tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1513 microversion: 2.1 time: 0.153061 Jul 18 17:08:33.339818 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 731/1461] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:33 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:34.359902 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a50edab4-01cc-410d-8902-ca5ee38c5beb tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:34.360514 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a50edab4-01cc-410d-8902-ca5ee38c5beb tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:34.367122 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a50edab4-01cc-410d-8902-ca5ee38c5beb tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:34.367575 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a50edab4-01cc-410d-8902-ca5ee38c5beb tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:34.368380 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a50edab4-01cc-410d-8902-ca5ee38c5beb tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:34.368792 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a50edab4-01cc-410d-8902-ca5ee38c5beb tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:34.524531 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a50edab4-01cc-410d-8902-ca5ee38c5beb tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:34.532371 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a50edab4-01cc-410d-8902-ca5ee38c5beb tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1513 microversion: 2.1 time: 0.176707 Jul 18 17:08:34.532949 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 731/1462] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:34 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:08:35.551354 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f4eecb60-4d38-4d34-8f0c-b86599836d2b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:35.552072 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f4eecb60-4d38-4d34-8f0c-b86599836d2b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:35.563549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f4eecb60-4d38-4d34-8f0c-b86599836d2b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:35.563549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f4eecb60-4d38-4d34-8f0c-b86599836d2b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:35.563549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f4eecb60-4d38-4d34-8f0c-b86599836d2b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:35.563549 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f4eecb60-4d38-4d34-8f0c-b86599836d2b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:35.594513 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-c3063d6e-269e-463e-af7a-cd9a23dd2d12 req-8e58bbf7-d8ad-4949-aa97-d32f340410d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b1b4c8d-01b6-45cc-971e-85e0a98471d2", "name": "network-vif-deleted", "tag": "01cfe727-9f26-410a-9575-3892544441c3"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:08:35.603093 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-c3063d6e-269e-463e-af7a-cd9a23dd2d12 req-8e58bbf7-d8ad-4949-aa97-d32f340410d1 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:35.603616 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-c3063d6e-269e-463e-af7a-cd9a23dd2d12 req-8e58bbf7-d8ad-4949-aa97-d32f340410d1 service nova] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:35.615737 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-c3063d6e-269e-463e-af7a-cd9a23dd2d12 req-8e58bbf7-d8ad-4949-aa97-d32f340410d1 service nova] Creating event network-vif-deleted:01cfe727-9f26-410a-9575-3892544441c3 for instance 9b1b4c8d-01b6-45cc-971e-85e0a98471d2 on hv-cinder-83754 Jul 18 17:08:35.620658 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-c3063d6e-269e-463e-af7a-cd9a23dd2d12 req-8e58bbf7-d8ad-4949-aa97-d32f340410d1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030279 Jul 18 17:08:35.621494 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 732/1463] 10.222.0.76 () {64 vars in 1317 bytes} [Mon Jul 18 17:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:08:35.627922 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f4eecb60-4d38-4d34-8f0c-b86599836d2b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fdca3c347134bd5a4c327c8b1230773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3312c4364471fb98f892fc1461bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:35.635679 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f4eecb60-4d38-4d34-8f0c-b86599836d2b tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 200 len: 1471 microversion: 2.1 time: 0.090025 Jul 18 17:08:35.636375 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 732/1464] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:35 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 1471 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:36.653998 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3d3fe35d-7bc7-487c-90c9-968d66640fec tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:36.654699 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3d3fe35d-7bc7-487c-90c9-968d66640fec tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] [instance: 9b1b4c8d-01b6-45cc-971e-85e0a98471d2] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:36.661083 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d3fe35d-7bc7-487c-90c9-968d66640fec tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:36.661544 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d3fe35d-7bc7-487c-90c9-968d66640fec tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:36.662314 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d3fe35d-7bc7-487c-90c9-968d66640fec tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:36.662758 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d3fe35d-7bc7-487c-90c9-968d66640fec tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Lock "c0091633-bf58-44a7-8bf2-495d496559e2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:36.676652 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-3d3fe35d-7bc7-487c-90c9-968d66640fec tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] HTTP exception thrown: Instance 9b1b4c8d-01b6-45cc-971e-85e0a98471d2 could not be found. Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3d3fe35d-7bc7-487c-90c9-968d66640fec tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Request method failure captured: Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 HTTP/1.1 Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Connection: close Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Host: 10.222.0.76 Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi1ZMR-tJ7kYN7sEEF64RQPLXbPPsf5wuLINcq0dGDH--B4nye92eFkHOYF9T4mHTUdSscRXv-sFrEy7AdLmbov42MHEDsEcDW0dQ5_mKm4NSyrW3IgAS2eik-nez9AqhMwysIvTGO9HUymQftwkbNkvOyrGsMXZgnSnkgouvgkuEHBF4 Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Id: 80a3312c4364471fb98f892fc1461bb7 Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1429965813 Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 18 17:08:36.678317 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 18 17:08:36.680276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_80a3312c4364471fb98f892fc1461bb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/80a3312c4364471fb98f892fc1461bb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/80a3312c4364471fb98f892fc1461bb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/80a3312c4364471fb98f892fc1461bb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jul 18 17:08:36.680276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesSnapshotTestJSON-1429965813 Jul 18 17:08:36.680276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 80a3312c4364471fb98f892fc1461bb7 Jul 18 17:08:36.680276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1429965813 Jul 18 17:08:36.680276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesSnapshotTestJSON-1429965813-project Jul 18 17:08:36.680276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 18 17:08:36.680276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 18 17:08:36.680276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Id: 0fdca3c347134bd5a4c327c8b1230773 Jul 18 17:08:36.680276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesSnapshotTestJSON-1429965813-project Jul 18 17:08:36.680276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: method: > Jul 18 17:08:36.680276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: exception: Instance 9b1b4c8d-01b6-45cc-971e-85e0a98471d2 could not be found. Jul 18 17:08:36.680276 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: action_args: {'id': '9b1b4c8d-01b6-45cc-971e-85e0a98471d2'} Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b1b4c8d-01b6-45cc-971e-85e0a98471d2 could not be found. Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:08:36.681361 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b1b4c8d-01b6-45cc-971e-85e0a98471d2 could not be found. Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b1b4c8d-01b6-45cc-971e-85e0a98471d2 could not be found. Jul 18 17:08:36.683291 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 18 17:08:36.684941 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3d3fe35d-7bc7-487c-90c9-968d66640fec tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] Returning 404 to user: Instance 9b1b4c8d-01b6-45cc-971e-85e0a98471d2 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:08:36.684941 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3d3fe35d-7bc7-487c-90c9-968d66640fec tempest-VolumesSnapshotTestJSON-1429965813 tempest-VolumesSnapshotTestJSON-1429965813-project] 10.222.0.76 "GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2" status: 404 len: 111 microversion: 2.1 time: 0.030551 Jul 18 17:08:36.684941 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 733/1465] 10.222.0.76 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:36 2022] GET /compute/v2.1/servers/9b1b4c8d-01b6-45cc-971e-85e0a98471d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:09:41.952559 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:09:41.953214 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Mon Jul 18 17:09:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:09:46.976545 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:09:46.977354 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Mon Jul 18 17:09:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:10:50.286216 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:10:50.286852 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Mon Jul 18 17:10:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:11:42.127399 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:11:42.128043 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Mon Jul 18 17:11:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:11:52.201972 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:11:52.202575 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Mon Jul 18 17:11:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:13:01.961984 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:13:01.962463 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Mon Jul 18 17:13:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:13:06.985259 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:13:06.986090 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Mon Jul 18 17:13:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:13:17.694995 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:13:17.695880 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Mon Jul 18 17:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:14:10.295475 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:14:10.296779 dv-cinder-837542-6-iscsi devstack@n-api.service[124868]: Mon Jul 18 17:14:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:15:02.135289 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:15:02.135918 dv-cinder-837542-6-iscsi devstack@n-api.service[124867]: Mon Jul 18 17:15:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!